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ABSTRACT 

Project ABC (Advancement Based on Competency) was a 
5~year study funded jointly by the Alberta Department of Education 
and the Calgary Board of Education. Funded at $999,950, the program 
took place from 1982 to 1987. It explored alternatives to the 
Carnegie Unit in three senior high schools, students, teachers, and 
administrators in the William Aberhart, John Diefenbaker, and Ernest 
Manning schools were administered questionnaires. Focus was on 
student achievement, curriculum adherence, removal of time as a 
credit requirement, competency as a basis for awarding credit, 
considerations for provincial applications, and budget 
considerations. Three independent models evolved: (1) the 
department-based model; (2) the parallel core program model; and (3) 
the school-wide model. Student achievement overall was generally 
comparable to non-project student achievement within Calgary and 
Alberta. Few significant differences were identified. Provincial 
curriculum was adhered to in individualized instruction and 
continuous progress formats, and in some cases was found to be 
superior. Findings indicated that the criterion of time could be 
removed and replaced by the criterion of demonstrated competency, and 
that competency was an appropriate basis for advancement at both unit 
and course levels. A review of the literature revealed that a similar 
but far more extensive study had been conducted in the United States 
from 1932 to 1940. It is conduced that personalized instruction and 
continuous progress are viable educational alternatives and should no 
longer be considered experimental. Eighty data tables, 1 figure, and 
24 graphs are presented. The student, teacher, and administrator 
questionnaires are appended. (Author/TJH) 
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ABSTRACT 



Project ABC: Advancement Based on Competency was a five-year 
study funded jOir ly by Alberta Education and the Calgary Board of 
Education for the sum of $999,950 which took place from 1982- 
1987. It explored alternatives to the Carnegie Unit in three 
senior high schools, Three independent models evolved from the 
project, specifically che Departmen*:-based Model, the Parallel 
Core Program Model and the School-wide Model. Student achievement 
overall was found to be generally comparable to non-project 
student achievement within the Calgary Board of Education and the 
Province of Alberta. Few significant differences were identi- 
fied. Provincial curriculum was adhered .0 in individualized 
instruction and continuous progress formats and in some cases was 
found to be superior. It was concluded that it was possible to 
remove the criterion of time and replace it with the criterion of 
demonstrated competency and that indeed competency was an appro- 
priate basis for advancement at both unit and course levels. 

A review of the literature revealed that a similar but far ^nore 
extensive study had been conducted in the United States from 1932- 
19^0 entitled the Eight-Year Study. Based on the findings of that 
study and this, nearly fifty years later, the conclusion was drawn 
that personalized instruction and continuous progress are viable 
educational alternatives and should no longer be considered 
experimental . 
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EXECUTIVE SUMMARY 



Project ABC: Advancement Based on Competency was a five-year 
study conducted from 1982-1987. It was funded jointly by Alberta 
Education and the Calgary Board of Education for a total of 
$999,950. Its purpose was to explore alternatives to the Carnegie 
Unit in three Calgary high schools. 

The Carnegie Unit was established in 1907 to regulate the distri- 
bution of college pension funds but quickly came to standardize 
the quality of high schools in North America. Currently in 
Alberta one credit requires a minimum of 25 hours of instruction; 
thus a five-credit course requires a minimum of 125 hours of 
instruction. It has long been felt, however, that more or less 
than the 125 hours might be more appropriate for an individual 
student's learning needs than the traditional requirement. In 
fact, a long-buried study entitled the Eight-Year Study was 
conducted in the United States from 1932-19^0 exploring flexible 
time use in the high school. That study concluded that departures 
from prescribed patterns of both time use and curriculum did not 
lessen students* readiness for college and that actually the more 
fundamental the changes instituted by the high school, the better 
the students achieved in college. 

Project ABC evolved from an interest held by Alberta Education in 
exploring alternatives to the Carnegie Unit and by a perceived 
need by the Calgary Board of Education to address the needs of 
dysfunctional students whose needs were not then being met by the 
high school . 

Each of the three schools in the project developed its own model 
and these are outlined below: 

Department-based Model - William Aberhart High School 

Business Education Program 

An open-area program offering all 20- and 30-level Business 
Education courses simultaneously throughout the school day 
in an individualized instructional format using continuous 
progress as the method for student advancement. 

Parallel Core Program Model - John G. Diefenbaker High School 

PEP (Personalized Education 
Program) 

A school-within-a-school model for core courses involving 
approximately 100 students in each of Grades 10 through 12 
v.»ho were selected for learning independence. A combination 
of flextime and demand time was used by students to orga- 
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nize their school day according to chelr perceived learning 
needs. The program was supported by a te^t centt-:^ and a 
Teacher Advisor syste^i. Enrichmer.t act ivi lies were 
stressed. 

School-wide Model - Ernest Manning High School 

PACE (Personalized and Continuous 
Education) 

An individualized, continuous progress model for Grades 10 
through 12 encompassing the whole school, supporced by a 
test centre and a Teacher Advisor system. 

A Steering Committee comprised of representatives from both 

Alberta Educacion and the Calgary Board of Education guided the 

evaluation of Project ABC and developed a series of evaluation 
goals, as follows: 

1 . Primary Goals 

To assess the success of project- schools !n providing students with accept- 
able alternatives to the tlme-c-edi t re* ationshSps expressed in the curren*^ 
Junior and Senior High School Handbook where: 

(a) The student achJevenient levef is .3S good as or beft-er than achievement 
levels, in bo^h local and provinci3l prografns. 

(b) The Aloerta Curriculum is adhe'-ed to. 

(c) Time nas been renoved as a reQj*rement fn awarding credit. 

(d) Competency has been made the baS'S for awarding cred'^. 

2. Secondary Goals 

(a) To provide project schools with information concerning studertb' 
educational experiences in terms of the principles of person-i:ued 
instruction and continuous progress. 

'b) To provide Alberta Education with information regarding adherence *o 
the Alberta Curriculum in project schoo's. 

(c) To provide Alberta Education with information for use in the ccns.- 
deration of prov»nce-wide appMcarion of alternatives to time credit. 

Further, several key concepts were defined by the committee. 
PersorxQlized instruction was defined as including: 

!• Placement appropriate to learning st/ie 

2. Varied learning environments 

3. A "stop me-chanism" for students to obtain assistance at any point in a 
course 

4, Demonstrated compe*'e'^cy in each unit of a course before proceeding to the 
next uni t 

5, Opportunities for enrichment 
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Continuous progress was defined as including: 



K A learning rate compatible wJt^ a&if'ly 

2, Flexible t 'netabHng to acco'nmodate persona i choice or need 
5. Advancement ba^ed on competency demonstrated rather than 
time spent in a course 

Later in the project, school personnel defined the concept of 
competency as follows: 

students must demonstrate a competency level of at least 501 in a unit or 
course before proceeding to the next unit or course. However, in certain 
cases, higher competency levels tor particular units may be required (e.g., 
Safety Unit in Chemistry). 

Based on these goals, a series of research questions was developed 
and an evaluation study was designed. There were two distinct 
parts to the evaluation: the formative evaluation which involved 
an annual cycle of evaluative -ct^ivities oalminating in an annual 
Formative Evaluation Report; and the ^ummative evaluation which is 
presented in this document. The form-it ive reports focussed on the 
concepts of personalize j instruction and continuous progress which 
u»?r^ of partiojlar interest to the schools* planning process, 
while the sumnia*:.ive report has addressed the evaluation goals 
idetiwified by the Steering Committee which were of particular 
rt^' -^ot to AI! »rta Ednoition. Both typ^s of evaluation looked at 
.^-tud*^* ^ 'tobip^?em-*nt ; attitudes ^nd perceptions of students, 
teaciici ^ oifK aoaJnistidiorj; ar»u contex^ua) data. In the final 
:xir of piojtct, a policy >iL\:ht study was conducted with ^ 
pan-^" mai-^ ip of oroject teaot'.ers ard administrators. This 
pio/ijti ddJaionai useful bacK^rouriii information such as 
-ed f-r ' -^ot ocnefirs vi ^'r<3, impcr-tant teacher 

^Li- t-'tcri^t.c and key corr.pc^:^:^ o" f--iec" ABC-type program. 

Student Achievement 

Student achievemcPit scores for 30- level courses in project schools 
were compared with the scores of all Calgary Board of Education 
and all Alberta students registered in those courses using the 
compjter program SPSS-X (Statistical Package for the Social 
Sciences) OMEWAY procedure, a univariate analysis of variance 
which identified significant differences between mean scores over 
time and between project mean scores and control group scores. 
This was followed bv post hoc testing using the Scheffe procedure. 

Study findings indicated that achievement levels of students 
within each program did not fluctuate significantly over the 
course of the project. Overall, achievement levels for project 
students were generally comparable with achievement levels of non- 
project students in the Calgary Board of Education and the 
Province of Alberta. Few significant differences occurred. 
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Curriculum Adherence 



Curriculum developed by Project ^BC teachers was reviewed annually 
by curriculum consultants from Alberta Education to determine if 
contents and standards in project courses remained comparable to 
those across the province. They concluded that the development of 
individualized materials did not have a negative effect on either 
content or standards and in some cases, particularly in the Paral- 
lel Core Program Model, the materials were judged to be superior. 

Removal of Time as a Credit Requirement 

Student perceptions were collected regarding key concepts related 
to the removal of time as a credit requirement and the development 
of competency as the basis for awarding credit through the admin- 
istration of a questionnaire which measured their attitudes and 
perceptions. Teachers and administrators were also polled with 
questionnaires. A sample of each of the three groups was inter- 
viewed annually to help clarify the data collected. For the 
summative analysis, key concepts on the student questionnaire were 
analyzed using the SPSS program ONEWAY followed by post hoc 
testing. Descriptive statistics for these concepts were also 
extracted from teacher and administrator questionnaires. 

All three models were determined to be functioning outside of the 
traditional Carnegie Unit allowing students more or less time than 
the 125 hours according to their learning needs. The Department- 
based and School-wide Models provided for continuous and indivi- 
dual progress from unit to unit and from course to course. The 
Parallel Core Program Model provided for variable learning rates 
within the unit but students proceeded from unit to unit together. 

Competency as the Basis for A\\?arding Credit 

Perceptions regarding competency as :he basis for awarding credit 
rather than time spent in a course were treated in a similar 
manner to those reported in the section above. Key concepts were 
selected for the summative analysis along with interview data. 

All three models were found to deal with competency issues rela- 
ting to non-traditional use of time. The School-wide Model was 
the most successful in terms of project evaluation criteria in 
making competency demonstrated rather than time spent the basis 
for awarding credit. The Department-based Model ?'-o achieved 
this goal, although some non-sequential material was handled 
differently at the unit level. The Parallel Core Program Model 
used a different approach, for while competency was the basis of 
awarding credit, individual rates of course completion were not a 
school goal. Instead student selection for the program and a 
variety of excellent instructional techniques helped to ensure 
that students would succeed 'ithin allotted time limits. 



Considerations for Provincial Application 



Results of the policy Delphi study conducted in 1987 provided 
useful contextual information. A number of project benefits were 
identified, most particularly for students who appreciated the 
opportunity to learn at their own rate and to work on a one-on-one 
basis with their teachers. Teachers and administrators also felt 
that students assumed more responsibility for their learning and 
developed confidence and independence. Teachers gained from the 
project as well in terms of increoOCJ freedom to experiment, 
greater awareness of different teaching styles and greater satis- 
faction. Alberta Education consultants believed that Project ABC 
teachers had grown professionally from the experience. The 
greatest benefit to the school to emerge from the project was the 
promotion of an atmosphere of cooperation between staff and 
students. Schools also gained materially from their involvement 
in the project through increased funding which provided support 
for paraprofessionals, improved library resources, additional 
computers, learning materials and instructional equipment. 

The most serious disadvantages or perceived problems emerging from 
the project were rated lower than the perceived benefits thereby 
highlighting the overall perceiveo benefit of the project. For 
students, the main disadvantage was the ease with which they could 
fall behind in their work. Teachers and administrators also felt 
that students sometimes lacked understanding about program demands 
and how to handle them. For teachers, perceived disadvantages 
included the added stress and potential burnout associated with 
being Dart of an alternative project, increased workload, and 
frustration with unclear goals, particularly in the School-wide 
Model. Problem areas identified for schools included increased 
resource needs, more complex resource management, and the need for 
strong leadership. 

Key components required for an alternative to time-credit program 
were identified, the most critical of which included: 

1. Specially selected teachers who demonstrate the characteristics of 
openness to change, industry, recept iveness, energy, Hexibtlity, who are 
team players and who support the alternative philosophy. 

2. Support from local board, the community and government. 

3. Adequate lead time for curriculum development and time for ongoing 
revision. 

4. Decisive leadership. 

5. A sound educational rationale coupled with adequate staff development and 
new teacher orientation. 

6. Effective student monitoring, tracking and record keeping systems. 

7. Clear and consistent policies, expectations and consequences fot students. 

8. A school-wide philosophy and total school staff involvement in a»id 
commitment to the alternative program. 

9. Adequate clerical and paraprofessional support. 

10. Adequate ongoing teacher release time for planning and coorili nation. 

11. Sufficient funding to initiate and maintain the program. 

12. Adequate program size to maintain one-on-one interaction between teachers 
and students. 
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13. 
14. 
15. 



Timetable f lexibi I ity. 

Good liaison with feeder* scf>oois. 

Good communication with pareprs. 



A final critical component which emerged from the perceptions of 
Alberta Education consultants and final-year interviews was the 
need for a flexible physical plane with a variety of instruct ional 
spaces available for large groups, seminars and inoividual soudy, 
as well as traditional classroom areas. 

Budget Considerations 

The different nature of a Project ABC- type program has some budge:: 
considerations which must be addressed before such a program can 
be developed. 

The first area is related to resources including a broader range 
of materials and multiple copies of audio-visual materials in 
order to meet the demands of an individualized program; stepped-up 
security; increased maintenance; information processing facilities 
such as computers, word processors, and photocopiers; and 
increased paper supplies. The second area relates to staff costs 
with an increased requirement for paraprofessional and clerical 
support, professional development costs for staff training and new 
teacher orientation, and teacher release time for inii:ial curri- 
culum development as well as annual release time for revision and 
planning. 

A decentralized budgeting model appears to be the most appropriate 
way of managing the more complex resource requirements placed on a 
school by a Project ABC-ty..e program. In this way, program 
priorities such as staffing can be supported by school-based 
decision making. 

Conclusions 

Conclusions of the Project ABC evaluation include: 

1. Achievement levels of Project ABC students were as good as 
student achievement levels in both local and provincial 
programs. 

2. The Alberta Curriculum was adhered to in ail three Project 
ABC schools. In the Parallel Core Program Model, provincial 
requirements were exceeded. 

3. The three Project ABC schools succe::sfully provided alterna- 
tives to the Carnegie Unit. 

^. Project ABC demonstrated that competercy rather than time 
spent in a course can become the basis for a^/i'^dirg credit. 
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5. Personalized instruction and continuous progress are viable 
educational alternatives and should no longer be considered 
experimental . 

6. Program delivery can be successfully individualized, although 
the nature of the subject matter will have an impact on the 
degree to which individualization can occur. 

7. Models for a Project ABC- type orogram should emerge from the 
nature of the individual school and its community. 

8. This type of program is particularly appropriate for students 
who are independent learners. 

9. This type of program is best implemented by teachers who 
support and practise the project philosophy. 

10. This type of pr-^ requires a clear program vision, commit^ 
ment of the total school staff and strong administrative 
leadership. 

11. This type of program requires more complex financial manage* 
ment than a traditional program and involves both start-up 
and maintenance costs which are different from traditional 
resource allocations in order to support i-ssource needs, 
professional development and orientation, teacher release 
time, and paraprofessional and clerical assistance. 

:2. A flexible physical plant design enhances the implementation 
of this type of program but it is not essential. 

Recommenda t ions 

Recommendations for the Calgary Board of Education include that: 

1. Contingent upon Alberta Education approval, the three Project 
ABC programs be granted exemption from the Carnegie Unit. 

2. Contingent upon Alberta Education approval, opportunity be 
provided for other Calgary Board of Education schools to 
offer Project ABC-type programs which are also granted 
exemption from the Carnegie Unit. 

3. The School-wide Model achievement levels be evaluated for an 
additional two years. 

4. Consideration be given to exploring different ways of alloca- 
ting resources to Project ABC-type schools. 

5. Consideration be given to the teacher characteristics identi- 
fied in this study as being critical to program success when 
assigning staff to Project ABC-type programs. 
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;nator. .1^^ cherr. .s la ^^^^^ opeiciv. pio^rain celi^*.;.. >'ne 
enroll i.ng sLudeius Fcoj-';^^, niiw :.ype programs. 

r. Fiexiole mstruotlo. al i5j.ciww uoni)i.dered in the ^..ac- 
tion o^" ne^M schools and Ine rer.w\ition of existing onc>. 

8. ProjeoL ABC teachers ana aarrixr.idi ators be formally eorrjTiehdec 
for their dedicarion anc conL^irmr-^nt in making these progiams 
successful and cha::, r-heit* saccesses be celebrated. 

Recommendations for Aiber ca EducaiiOL include that: 

1. Contingent upon Calgary Board of Education approval, the 
three Project ABC prograins be granted exemption from the 
Carnegie Unit. 

2. Opportunity be given for Alberta scnooi jurisdioclcns to 
offer Project ABC-type programs which are also granted 
exemption from the Carnegie Unic. 

3. Incentives be provided for school authorities embarking on a 
Project ABC-type program to support model development. 

4. A clearing house for indiv^cualized curriculum mater i^ils be 
established . 

5. Consideration be g^ve'. nor-c frequer... adminislrati of 
Grade \1 Diploma EAamiri^t.^iio aurmg the year to accoir::.. ^ute 
the needs of students oont^ii^^iS progress progranis. 

6. A follow-up study be ccuGucieJ to determine the success of 
Project ABC students .n posv-scconddry progranr.s or work 
environments. 

ImpWcatxons 

Implications of Project ABC extend far beyond 1987. In parti- 
cular, the proposed Alberta School Act fits well with a Project 
ABC-type model. The proposed legislation allows for program 
flexibility in terms of time use and also in terms of personal izea 
instruction and continuous progress. It is suggested that any 
school board may offer an alternative program such as Project 
ABC. Further, the proposed Directions for Senior High Programs 
and Graduation Requirement ( 1987) advanced by Alberta Education 
allows boards to explore alternatives to the Carnegie Unit 
provided that students have access to at least minimal required 
instructional time. 

There are other implications for those who have been involved in 
Project ABC. Teachers who have taught in project schools find 
that their teaching styles have been permanently altered and their 
skills enriched. Students have had their learning needs addressed 
in a number of innovative .-.'ays. Some have experienced s'xqc^s^ 
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through the provision of additional time. Others have been 
challenged by enrichment activities they would not have had time 
for before. Still others have been able to concentrate on areas 
of weakness while moving more quickly through areas of strength. 
Many have learned time management skills and have had closer, more 
satisfying relationships with their teachers. Administrators have 
been challenged zo find innovative solutions to staff development 
needs, budget constraints, student tracking and record keeping and 
school leadership problems. 

Additional research should evolve from this study to track project 
students* success in post-secondary or career situations. The 
School-wide Model could benefit from two more years of student 
achievement evaluation as the Grade 12 program was operational 
only in the final year of Project ABC. The impact of the study 
should be monitored in terms of teacher development over the next 
five years. There is a lot of follow-up data waiting to be 
collected to determine the true extent of the impact of Project 
ABC. 
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CHAPTER 1 - PROJECT OVERVIEW 



Project ABC: Advancement Based on Competency was a five-year 
project (1982-1987) funded jointly by Alberta Education and the 
Calgary Board of Education, Its purpose was to explore alterna- 
tives to the Carnegie Unit. This chapter provides an overview of 
why the project was needed, how the project was established, what 
its goals were and how it was to be evaluated. 

Project Need 

Traditionally in high schools, time, credit and achievement were 
linked with progress. A student" had to spend 125 hours in a 
course ana achieve a passing pradp in orJer t:o receive five 
credits regardless of che pace at which he mastered concepts or 
skills. Even if he were able to prorT-.^^^ moro quickly than the 
eJass, he could not, caught ai^ ho wa.^ 1. th^* jock-step format 
which prevented the enrolment m seqjeuiinl courses in the same 
terrT^. Conversely, if he needed more time than the norm, he had to 
fall back and repeat the complete course even though he only 
required part of it. 

Project ABC provided three Calgary high schools with the opportu- 
nity to "break'* the Carnegie Unit by removing the fixed time- 
credit relationship and replacing it with continuous progress 
based on competency. In this way, the awarding of credit became 
dependent on individual competency levels rather than "seat time." 

The schools involved in the project were William ^.berhart High 
School, John G. Diefenbaker High School, and Ernest Manning High 
School, Each school developed its own alternative model but they 
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Were united in their goals of exploring personalized learning 
methouologies and continuous progress delivery systems. The three 
models were as follows: 

Department-based Model - Business Education Program 
at William Aberhart High School 

Parallel Core Program Model - Personalized Education 
Program (PEP) at John G. Diefenbaker High School 
School-wide Model - Personalized and Continuous 
Education (PACE) ac Ernest Manning High School 

Project History 

In 1980, Alberta Education released two reports exploring the pros 
and cons of the Carnegie Unit' and indicated to school jurisdic- 
tions that there might be financial support for the development of 
high school programs which prG>;ided an alternative to it. 

Concurrently, high school administrators in the Calgary Board of 
Education had been wrestling uith possible ways to address the 
needs of dysfunctional studer^ts who either were unable to handle 
the regular program, were significantly underachieving or who were 
gifted or talented and needed challenges beyond the regular 
program.^ As one school administrator put it: 

The frustration we face, given the realities of the System- 
wide testing, the Carnegie Unit, Department of Education 
policy, and the winds of the '*back to the basics movement," 
is that there is little opportunity to creatively address 
the problem of what to go with these students. From our 
experience here, we suspect that there are possible 
solutions ranging from curriculum modification, to flexible 
timetabling and organization, to staff development, to 
development of true alternative approaches to secondary 
education.^ 

Based on the recommendation of a Calgary Board of Education report 
called The Unreached or Dysfunctional Youth in the Senior High School, 
a task force was established to explore the needs of these 
students who did not appear to fit in traditional programs and who 
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would be better served in an alternative learning environment. 
The task force reviewed alternative programs all over North 
America focussing on those which had attempted different forms of 
continuous progress in order to loosen the relationship between 
time spent and credit awarded. 

However, many of the American programs were beginning to fail at 
that time for a number of reasons. The main problems encountered 
had included economic restraints, heavy staff workload due to 
individualization, lack of in-service, poor student tracking 
systems and insufficient orientation of students and parents.^ 
The task force determined that the concept of alternatives to the 
Carnegie Unit was sound and that viable programs could be esta- 
blished if safeguards were incorporated to deal with the above- 
mentioned problems. 

The Calgary Board of Education approached Alberta Education 
regarding a potential project and was favorably received. And so 
the task force accepted submissions from four or five interested 
schools and selected William Aberhart, John G. Diefenbaker and 
Ernest Manning High Schools for inclusion in the project. A 
proposal for a five-year project, 1982-1987, for $999,950 was 
forwarded to Alberta Education under the title Advancement Based 
on Competency and received approval. The Calgary Board was to 
provide PiOf. of the funding and Alberta Education the other 5055. 



Goals 



The evolutionary process described which resulted in Project ABC 
produced two levels of goals - individual school program goals and 
project goals. The fit between the two would never be complete 
and engendered some ongoing problems. 
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The project proposal was based on three major theses:^ 

1. Learning can be more effective if the process is person- 
alized for the student. 

2. The quality of achievement can be r.iproved if corrpotence 
must be demonstrated at every defined intermediate sta^e 
of learning. 

3- Learning opportunities can be enhanced if aco«?s^ to 
courses is made more flexible. 



Project objectives were outlined as follows:^ 



1. To provide selected students in three Calgary high 
schools with alternative delivery systems to the tradi- 
tional time for credit model, for a five-year period. 

2. To develop and provide curriculum at the senior high 
school level which is based on the principles of person- 
alized instruction and continuous progress. 

3- To provide staff involved in the project with oppcrtunity 
to acquire knowledge and develop expertise in th-. 
instructional application of personalized learning 
systems and continuous progress. 

U. To develop and^or adapt instructional materials to 
provide students with personalized learning e:-:p<:-riences 
and tests to measure those experiences. 

5. To develop and maintain administrative procedures to 
manage the learning process, monitor student progress, 
keep records, and report credits received. 

6. To incorporate .^n ongoing evaluative component into the 
project in order to provide bo:h annual forMt ive 
evaluation information as feedback into the plannin.3 
process, and also a summative evaluation report at the 
end of the five-year period to measure the success of the 
project. 

7. To provide Alberta Education with information rcg-.»din/. 
alternatives to time for credit for use in the considera- 
tion of province-wide application of these alternatives. 



Upon approval of the project, a Steering Committee was strucr.- 
comprised of Alberta Education representatives from Currioulun and 
Planning and Research. Calgary Board of Eauoation admirastrators 
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representing the Superintendent and Instructional Services, and 
the Project Director. 



A process of negotiation recurred in the Steering Committee 
regarding goals for the project evaluation and a numl^r of evalua- 
tion goals were identified.® The primary goals included the 
following: 

To assess the success of project schools in providing students 
with acceptable alternatives to the time credit relationships 
expressed in the current Junior and Senior High School hand- 
book where: 

1. The student achievement level is as gooa as or better than 
achievement levels in both local and provincial programs. 

2. The Alberta Curriculum is adhered to. 

3. Time has been removed as a requirement in awarding credit. 
Competency has been made the basis for awarding credit. 

Tne s^corfi^ii ; evaluation r>'ia^ *J'■•^♦!^ieJ bv :hc cowattee 
inciuded tne following: 

5 . To provide project schools wi Lh inform-it ion concern ing 
students' educational experiences in terms of the princi- 
ples of personalized instruction and continuous progress. 

6. To provide Alberta Education with information regarding 
adherence to the Alberta Curriculum in project schools. 

7. To provide Alberta Education with information for use in 
the consHeration of province-wide applicatioii of alter- 
natives to time credit. 

As well as determining evaluation goals, it was necessary to 
define some of the key concepts in the project. Again, through 
the process of negotiation, the committee defined the terms 
personalized instruction and continuous progress for the purposes of 
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the project. Personalized instruction was defined to include the 
following components: 

1. Placenent appropriate to learning style. 

2. Varied learning environments. 

3. A "stop mecha'>ism" for students to obtain assistance at any point in a 
course. 

4. Demonstrated competency in each unit in a course Defore p''Oceed»ng to the 
next uni t . 

5. Opportunities for enrichment. 

The concept of continuous progress was defined to include the 
following components: 

1. A learning rate compatible with aDtlity. 

2. Flexible timetabling to accommodate personal choice or need. 

5. Advancement based on co^jpetency denionstrated rather than tJfne ■i»pent in a 
course. 

During the course of Ir.e project, school personnel defuKJ the 
concept of competency foiiowi?: 

S-ude^t; musi demonstrate a corp.jtercy fo^oJ of Jt leac^t iOi m j ^mt or 
course before proceeding to the next unit or co«jr^e. However, *n certjir. 
cases, higher co"^petency levcJ ^ tor part.cuiar unit:^ may be rcQu*^e<3 (o.Q., 
Safety Unit in Chemistry). 

As stated in the project goals, an evaluative component was incor- 
porated into yearly activities. A formative evaluation was 
prepared at the end of each school year which fed the following 
kinds of information back into the project planning cycle: 

1. Academic Evaluation - Comparison of final grades with local 

and provincial control groups 

2. Attitudinal Evaluation - Measurement of project participants* 

satisfaction and perceptions regard- 
ing project activities 

3. Contextual Evaluation - Review of a variety of project acti- 

vities including curriculum, budget, 
methodology, etc. 
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In the last year of the project (1986-I987), a policy Delphi study 
was conducted with a panel of Project ABC teachers and adminis- 
trators to provide further contextual data for the project evalua- 
tion. 

Finally, suminative evaluation activities were conducted in 1987 to 
pull the many strands of this complex project together. These 
activities are recorded in this report. In Chapter 2, the litera- 
ture relating to the Carnegie Unit is briefly reviewed. In 
Chapter 3, an outline of study methodology is provided for both 
formative and summative stages. In Chapter H, findings are 
presented which relate to the project as it evolved in each of the 
the three models. In Chapter 5, summative project-wide findings 
are reported. And in Chapter 6 some conclusions about project 
success are drawn, some recommendations advanced and implications 
for the province discussed. 
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CHAPTER 2 - PROJECT ROOTS: A REVIEW OF THE LITERATURE 



A review of the literature related to the Carnegie Unit and 
projects which examined it is outlined below along with some brief 
comments on other project roots. 

The Carnegie Unit 

The practice of awarding 'che Carnegie Unit or Unit-of-Credit at 
the high school level has a history which dates back to the turn 
of the century. In 1905 the Carnegie Foundation for the Advance- 
ment of Teaching was established by Andrew Carnegie primarily to 
distribute funds to retired professors. In order to determine 
which Institutions were eligible for the funds, the Foundation had 
to define "college" and "high school." In 1907, it set the stand- 
ard of 1^ units of high school work as the basic minimum for 
student admission for a college wishing to receive Carnegie 
pension funds. A standard unit was defined as five hours of 
related work per week, or five periods of hO - 60 minutes, for a*- 
least 36 weeks. High schools had to accept these standards if 
they wanted their graduates to be admitted to approved colleges. 
By 1909, the majority of high schools and colleges across the 
United States had officially adopted the standards recommended by 
the Carnegie Foundation.' 

Although the initial intention of the unit was directed toward the 
colleges, it soon became a means of developing a uniform standard 
of quality across high school courses and programs. Undoubtedly 
its greatest impact has been, and continues to be, upon high 
schools and their students. 
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Most provinces in Canada have been influenced by the concept of 
the Carnegie Unit, although none has adopted it in its entirety. 
A credit system was introduced in Alberta in 1937 and was phased 
in over a three-year period. A school day consisted of eight 
class periods, each of approximately 40 minutes. Thus, 40 periods 
were available for instruction each week. Most subjects carried a 
value of five credits; a minimum of 100 credits was required to 
qualify for a high school diploma.^ 



Today, Alberta high school accreditation is based on both an 
achievement component and a time component. This time^credit 
relationship is quite explicit with regard to the awarding of 
credit and is currently expressed as follows: 

... one credit requires a minimum of twenty-five hours of instruction time per 
year or per semester. Hence, a five-credit subject must receive a minimum of 
one hundred and twenty-five hours of instruction time. This represents 
approximately one forty-minute period per day, five days per week for every 
week of the school term (assuming a ten rnonth school year). A three-credit 
course shall receive not less than 62^% hours of instructional time.^ 

Advantages in the use of the Carnegie Unit as the basis for high 
school organization have been identified as including the follow- 
ing: 

1. Establishes the concept of a three- or four-year high 
school and the use of a diploma as a requirement for 
graduation. 

2. Establishes the concept of a high school diploma as the 
basis for entrance to colleges and other post-secondary 
institutions. 

3. Simplifies the preparation of college-bound students. 

4. Provides uniformity in time allotments for high school 
subjects. 

5. Is easily understood by principals, teachers, students 
and parents. 

6. Regularizes programming and scheduling. 

7. Gives teachers a sense of security about amount of time 
to cover a given subject or course. 

8. Is convenient for academic bookkeeping. 

9. Can be used easily to measure the time spent on a 
subject. 

10. Assists in course planning and development. 

11. Is universally accepted and encourages the development 
and maintenance of comparable educational standards 
across the country.'* 
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Disadvantages or criticisms of the Carnegie Unit which have been 
identified include the following: 

1. Emphasizes the evaluation of a student's high school work 
in terms of how many hours and years he puts into a 
subject rather than how much knowledge and competence he 
acquires. 

2. Demands rigid requirements in subjects making innovation 
difficult. 

3. Gives undue emphasis to time served rather than to 
quality of learning and to needs, interests and abilities 
of the student. 

H. Demands all students to earn the same number of credits 
to graduate and makes no allowance for previous knowl- 
edge. 

5. Assumes all students can acquire the same amount of 
knowledge in a given period of time. 

6. Credits earned are not necessarily comparable fr m school 
to school. 

7. Absolute value of credits varies considerably from 
subject to subject. 

8. Assumes that certain academic skills and knowledge are 
necessary but de-emphasizes life skills. 

9. Does not measure affective growth.^ 

10. Poses some hardship on learning disabled students 
enrolled either full cr part time in special programs.^ 



The Eight-Year Study 



Of particular relevance for Project ABC is the Eight-Year Study, 
conducted in the United States half a century ago. It was an 
ambitious and, from our perspective, idealistic venture which 
warrants further examination here. 



By 1930, the high school was much as it had been in 1910 and was 
perceived as being restrictive, while the elemen**ary school had an 
informal atmosphere with varied activities and learning materials. 
High school staffs felt that they were prevented from making 
needed improvements because of rigid college requirements. The 
Great Depression of 1929 resulted in large numbers of young people 
enrolling in high school because they had nothing else to do. 
Most did not intend on going on to college and they found little 
meaning in their high school program. Teachers and administrators 
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recognized this lack o relevance but at the same time did not 
want to jeopat^dize cha. s of college admission for those who did 
want to go on. Many favoured a reconstruction of the high school 
curriculum to meet these conflicting needs. ^ 

In October 1930, the Commission on the Relation of School and 
College was established under the auspices of the Progressive 
Education Association. Its purposes were as follows: 

1. To establish a relatiDnship between school and college 
that would permit and encourage reconstruction in the 
secondary school. 

2. To find, through exploration and experimentation, how the 
high school in the United States could serve youth more 
effectively.^ 

The Commission was concerned with the needs of all high school 
students, but particularly with chose of students planning to go 
on to college, and sought to establish conditions in schools which 
would develop in students a strong sense of individual and social 
responsibility by making school work meaningful and relevant. 

The Commission's proposal stated the goal of the study as follows: 

We are trying to develop students v;ho regard education as an 
enduring quest for meanings rather than credit accumulation ; 
who desire to investigate, to follow the leadings of a 
subject, to explore new fields of thought; knowing how to 
budget time, to read well, to use sources of knowledge effec- 
tively and who are experienced in fulfilling obligations which 
come with membership in the school or college community.^ 

The project involved the release of a group of 30 schools from the 
usual subject and unit requirements for college admission for a 
period of five years (later extended to eight) beginning with the 
class entering college in 1936 and therefore beginning high school 
in 1932. Over 300 colleges and universities across the States 
complied by waiving the usual entrance requirements, the Commis- 
sion received generous funding from both the Carnegie Corporation 
and the General Education Board of the Rockefeller Foundation, and 
the process of "reconstruction" began. 
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The "Thirty Schools," as they became known, were selected across 
the country and represented both public and private schools and 
large and small ones. They all, however, were schools of "highest 
character and excellence and established reputation."'^ Each 
school developed its own plan for reconstruction, deciding what 
changes should be made in curriculum, organization and procedure. 
The Commission established a Committee on Evaluation and Record* 
ing, directed by Ralph W. Tyler, which provided a great deal of 
support to the faculties of the Thirty Schools but left to them 
the freedom and responsibility to initiate change as they saw fit. 



Most nolable among the changes wrought by schools during the 
Eight-Year Study were the following: 

Curriculum School-determinea curriculum 

Greater unity and continuity among courses and 
subjects 

increased relevance of subject matter to adoles- 
cents 

Variety of student products instead of tests and 
examinations 

Encouragement to pars'ie qreas cf interest 

Increased challenge for gifted students 

Greater stress on the arts, philosophy, logic, 
rules for discussions, problem solving and criti- 
cal thinking 

Delivery Student-centered instruction 

Variety of methods such as small group and inde- 
pendent as well as large group activities 

Use of a variety of resources instead of reliance 
on a text 

Increased use of the school library 

Use of the community as a demonstration labora- 
tory 
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Tncreasei individual student at tent ion and 
guioance 

Use of the te^iohpr a? a counsellor in a homeroom 
setting (sometimes daily for up to three years) 

Administration Democratic decision-making processes in both the 
school and the classroom 

Increased need for joint planning by teachers 

Increased teacher self-esteem through involvement 
in decision making and their own personal and 
professional growth 

Increased parent involvement 

Consideration of the role of the school in the 
community 

Better relations with colleges and universities 

Evaluation C9.reful recording, reporting and measurement of 

results 

Feeding of evaluation findings into the planning 
cycle 

Development of a variety of non-tradicional 
evaluation instruments that went beyond the 
measurement of skill and knowledge acquisition 



Tyler directed a follow-up study which pursued students* careers 
in college once they had graduated from the experimental schools. 
A group of 1475 students was meticulously paired with non-experi- 
mental school graduates in 25 of the participating colleges and 
the records of both groups were tracked. Sources of information 
included official college records, lists of honours and prizes, 
reports from instructors, samples of written work, results of 
college tests and annual student questionnaires and interviews. 

A comparison of the 1^75 matched pairs disclosed that graduates of 
the Thirty Schools: 

1. Earned higher grade averages in all subject fields except 
foreign languages. 



33 



. 14 - 



2. Received slightly more academic honours each year. 

3. Were more often judged to be motivated, systematic, 
objective, resourceful and aware. 

4. Participated more frequently in and were more appreci- 
ative of the arts. 

5. Participated in more organized student groups (except 
religious and service groups) and earned a higher per- 
centage of non-academic honours J ^ 



Further analysis by sub-group showed that the graduates from the 
six schools whicli had made the most marked departures from conven- 
tional approaches were strikingly more successful when compared 
with their counterparts than students from the six schools which 
had mad3 the least changes This difference was expressed in 
study findings as similar to a score of 27 to 7 for the least 
conventional schools compared to their controls and a score of 14 
to 16 for the most conventional schools compared to their 
controls A committee of college officials examined study 
findings and concluded: 

The results of this study seem to indicate that the pattern of 
preparatory school program which concentrates on a preparation 
for a fixed set of entrance examinations is not the only 
satisfactory means of fitting a boy or girl for making the 
most out of the college experience. It looks as if the stimu- 
lus and the initiative which the less conventional approach to 
secondary school education affords sends on to college better 
human material than we have obtained in the pastJ^ 



The Eight-- Year Study Chairman, Wilford M. Aikin, concluded: 

1. The graduates of the Thirty Schools were not handicapped 
in their college work. 

2. Departures from the prescribed pattern of subjects and 
units did not lessen the student *s readiness for the 
responsibilities of college. 

3. Students from the participating schools v/hich made most 
fundamental curriculum revision achieved in college 
distinctly higher standing than that of students of equal 
ability with whom they were compared. 
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He saw these conclusions as having two profound implications. The 
first was that traditional school-college relations were unsound 
because emphasis was placed on such outworn symbols as units, 
grades, rankings and diplomas The second was that secondary 
schools could be trusted with more freedom than college require- 
ments had permitted to that timeJ^ 

The direct impact of the Eight-Year Study on secondary education 
was disappointing. Although teachers involved in the study used 
the findings in their own work, administrators and school boards 
did not pursue study implications. According to Tyler himself, 
virtually no attempt was made to publish study conclusions apart 
from the five-volume report which was published in 19^2.'^ This 
was because the involvement of the United States in World War II 
had an adverse effect on the potential dissemination and influence 
of study findings.'^ 

Indirectly, however, the study had a number of significant out- 
comes. Tyler identified a number of them as follows: 

1. Widespread acceptance of the idea that schools could 
develop programs which would interest their students and 
still prepare them for success in college. 

2. Recognition by colleges that high school graduates need 
not meet specific subject requirements. 

3. The freeing of high schools from the heavy dominance of 
college entrance requirements in program development. 

4. The development of the in-service workshop to assist 
teachers in developing instructional programs and mate- 
rials. 

5. Wide acceptance of the concept of educational evaluation 
as a procedure for appraising the attainment of the 
objectives of an educational program which superseded the 
narrower concept of testing to assess programs and 
student progress. 

6. The recognition by educators of the value of defining 
educational objectives in terms of the behaviour patterns 
students are encouraged to acquire. 
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Further, Cuba and Lincoln point out that Tyler's rational and 
elegant evaluation process based on objectives was a major step 
forward for the fledgling field of educational evaluation, 
although it has since been superseded by more naturalistic 
approaches.^' In addition, this major research project provided 
experience for a number of influential figures in the fields of 
education, evaluation and psychology, including Benjamin Bloom, 
Bruno Bettelheim, and Lee J. Cronbach. Among the many teachers 
who took part in the project was J. Lloyd Trump, who will be 
referred to later in the chapter. 

Study weaknesses included the following, as identified by Tyler; 

1. Design biased in favour of the experimental schools. 

2. Locally determined objectives concurred "rather remark- 
ably" with those of \:he central evaluation staff. 

3. More interest in experimentation with teaching and 
counselling practice.^ rather than in the study's osten- 
sible goals. 

In addition, it must be pointed out that the study focussed on the 
one in six high school students who wenc on to college. It made 
no attempt co track the impact of "rcer^jtruction" on those who 
went to work. 

However, the study remains an educational benchmark, demonstrating 
the professionalism and courage of those educators fifty years ago 
who challenged the status quo and proved that there was more than 
one "right" way to educate adolescents. 

Other Project Roots 

Two other educational concepts embodied in Project ABC are indi- 
vidualized instruction and continuous progress. As well, one 
particular man, namely J. Lloyd Trump, was influential in the 
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development of project concepts. Each of these is explored 
briefly below. 

Individualized Instruction 

Frederic Burk, President of the San Francisco Normal School in the 
teens of this century was greatly impressed with individual 
differences among school children. ^-^ He developed the concept of 
self-instructional materials to enable classmates to work on 
different assignments at different rates. Two of his staff 
members, Carleton Washburne and Helen Parkhurst, moved on to jobs 
in different oarts of the country taking the idea with them. Each 
developed and published plans for individualizing instruction. 
These plans became widely known and influenced many teachers and 
schools to use workbooks and other forms of self-instructional 
materials. 

In 1919, Washburne identified two separate parts to the curri- 
culum: common essentials and group and creative activities. 
Common essentials involved the use of largely self-instructional 
activities on which the student worked at his own rate, then 
testing himself for mastery and, if successful, following that up 
with a test provided by the teacher. If he passed the test, he 
went on to the next unit; if he did not, he had a conference with 
the teacher who provided guidance and more independent work. In 
the group and creative activities, students had individual respon- 
sibilities. Grouping was based on age and social maturity, 

Parkhurst founded . an elementary and high school for crippled 
children, also in 1919. She emphasized the provision of opportu- 
nities for each student to pursue interests, to study at their own 
rate and to live constructively and cooperatively. Learning 
contracts were employed in which students could select interest 
areas, identify parameters and set the pace. Students were 
required to complete each unit before going on to a more advanced 
one. 
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These two plans were very influential in the 1920s and 1930s. 
Major innovations included: 

1. Use of workbooks co provide relevant practice materials. 

2. Recognition of both knowledge acquisition and socialization as 
functions of the school. 

3. Grouping procedures which did not stigmatize slow learners. 

4. Procedures for providing for individual differences in 
learning rates and in special interests. 

Continuous Progress 

The concepts of individualized instruction and continuous progress 
work together because once students are released from lock-step 
instruction, traditional groupings break down. Various forms of 
continuous progress have been evident for most of the century as 
indicated earlier. 

In Canada in recent times, continuous progress has been an alter- 
nate delivery system in a number of schools. The Ontario 
Teachers* Federation published a case book on continuous progress 
schools in 1972. This study examined 11 different Ontario 
schools from elementary to high school which were working on forms 
of continuous progress at that time. Each school had certain 
characteristics which differentiated it from the others as 
programs responded to community needs. Each was at a different 
level of implementation; however, they each operated with fixed 
curricula and standardized textbooks. Similarities noted included 
the following: 

1. Organizational capacity to adapt to a new concept. 

2. Belief in continuous progress as an ideal educational 
philosophy. 

3. Acceptance of the concept wholeheartedly by the school 
staff. 

4. Pupils grouped according to ability, interest and age. 
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5. Greater use of field work, individual research, the 
school library and audio-visual aids. 

6. Need for individualized work areas hampered in several 
schools by lack of space or inappropriate building 
design. 

7. Need for new methods of reporting to parents,^^ 

In Alberta, continuous progress has been implemented for a number 
of years in M. E. Lazerte High School in Edmonton, Sir Winston 
Churchill High School in Lethbridge, and Bishop Carroll High 
School in the Calgary Catholic School District. 

J. Lloyd Trump 

J. Lloyd Trump developed an interest in educational innovations 
when he was working on curriculum development for a new consoli- 
dated twelve-grade school in 1929. During the 1930s, he taught in 
one of the Thirty Schools of the Eight-Year Study. In I96I, he 
became a staff member for the National Association of Secondary 
School Principals and since then has directed four nation-wide 
studies.^^ 

One of these studies was the Model Schools Projecc, a five-year 
project which later expanded to eight years. It was funded by the 
Danforth Foundation in I968 to demonstrate that students' educa- 
tional opportunities would be enhanced when a variety of educa- 
tional innovations was coordinated over several years with 
improved methods of program evaluation. Between 32 and 34 
schools participated in the project for varied lengths of time, 
most of which were in the United States. However, one school was 
in Germany and another was Bishop Carroll High School in Calgary. 

Bishop Carroll has been offering a continuous progress, individua- 
lized approach since 1971.^^ Program highlights include the 
following: 

1. A continuous progress approach to instruction with emphasis on 
independent scudy for all students; 



ERLC 



39 



- 20 - 



2. A school building, designed for the new approach to education, 
which does not include traditional classrooms; 

3. A Teacher-Advisor Program tied directly to individualized 
independent study; 

4. Teachers working in teams and aided by a large support staff; 

5. A modularized curriculum divided into seven areas of knowledge 
with graduation requirements in each; and 

6. Flexible student scheduling, including opportunities for off- 
campus learning experiences for credit. 



Trump also directed the NASSP Commission on the Experimental Study 
or the Utilization of Staff. Frequently referred to as the Trump 
Plan, the Commissior. recommended the division of a student's time 
into H0% independent study, l\0% small group activity and 205^ large 
group activity. The plan has been used most frequently with above 
average students^^ and few schools have met the Commission's 
recommended division of time^^, but some of the Trump Plan 
features have been inco;*porated widely, including innovative 
school designs to accommodate varied types of instruction. 



Trump .also co-authored a text on improving secondary school curri- 
cula, taking the above-mentioned concepts into account.^' Among 
other innovations he addresses the non-grad'?d, continuous progress 
school and suggests the following: 

For maximum curriculum improvement, the non-graded school must 
use team teaching, flexible scheduling, technical devices, and 
the teaching-learning methods ...that deal{t) with independent 
study, large-group instruction, and small-group discussion. 
It must also adapt to the socioeconomic, political, cultural, 
and other characteristics of the areas where its students 
live. ...The non-graded school negates student frustration 
because it lessens the pressure for conformity. Students are 
comfortable with a peer group with whom success is a distinct 
possibility ... [and] enhances the possibility of individua- 
lized learning. 



This search for Project ABC roots reveals some startling findings. 
This educational innovation is actually based on concepts which 
have been evident in the field of education for over fifty years. 
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The Carnegie Unit was initially established for the distribution 
of college pension funds, but it has come to regulate our high 
school system. By 1930, it was considered outdated and restric- 
tive. Individualized instruction was experimented with as early 
as 1919 and with it came the ideas of varied learning rates, 
continuous progress, mastery learning, student-centered curricu- 
lum, advancement based on competency and learning contracts. The 
Eight-Year Study, commencing in 1932 and advancing far beyond the 
parameters of Project ABC, followed its students through their 
university careers. It proved that non-standardized curricula and 
the removal of time and credit requirements not only did not 
hinder students* success in college, these actually enhanced 
students* success in both academic and non-academic pursuits. 

Experimental cont nuous progress schools have been in Canada in 

recent times since 1971. Each experimental school is organized 

somewhat differently to meet local needs but they all share a 
number of similar characteristics, ^s follows: 

1. Deletion of a numot^r of restrictive praccices which gr.'^up or 
categorize students, such as the Carnegie Unit, credito, and 
grades. 

2. Student grouping arrangements based on student simj lar ities 
or interests. 

3. Broader-ranging, more sttident-centered curriculum. 

Greater variety of instructional methods such as small 
groups, large groups, independent study and field trips. 

5. Continuous progress. 

6. Individualized instruction. 

7. Increased student and teacher satisfaction. 

8. Strong staff commitment. 

S. Improved communication with parents. 

10. Greater focus on appropriate evaluation, both for students 
and for programs. 
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One final characteristic which appears to be evident but which 
lacKs firm documentation is that of improved student achievement 
at the secondary level. Project ABC attempts to address this 
issue by making it a research topic. 
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CHAPTER 3 - DESIGN AND METHODOLOGY 



The design and methodology employed in Project ABC for both 

formative and summative evaluation studies is outlined in this 

chapter along with some comments on study problems and 
limitations. 



Overview 

The purpose of the evaluation of Project ABC was to assess the 
success of project schools in providing students with acceptable 
alternatives to the traditional time-credit relationship expressed 
by the Carnegie Unit. This was achieved through a two-tiered 
approach to evaluation which involved both a formative and summa- 
tive design. 

For each of the five years of the project (1982-I987), a cycle of 
formative evaluation activities was conducted, culminating in an 
annual Formative Evaluation Report produced in the autumn follow- 
ing each school year. The formative report presented annual 
findings of model progress toward project goals and also served as 
a feedback mechanism for school administrators and staff regarding 
the affective response of project participants. These reports 
were for internal consumption only due to the temporary nature of 
findings related to an evolving project, and circulation was 
limited to project participants and Steering Committee members. 

The summative evaluation activities which are reported here rely 
heavily on the five years of data collected between 1982 and I987 
but the focus is different. In this document conclusions are 
drawn about project success from a provincial perspective. Over- 
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riding questions to be answered include the following: Are there 
viable alternatives to the Carnegie Unit? Is the concept of 
advancement based on competency a sound one? Should school 
systems incorporate advancement based on competency as an alterna- 
tive for their students? In order to focus on these and other 
critical questions, data from the five years of the project are 
either summarized or key items extracted for analysis to provide a 
global review. 



Scope 

To guide the design of the study, the following, nine research 
questions were posed: 

1. What changes occurred in che achievement of project students 
during the course of the project? 

2. How did achievement levels of project students compare with 
those of non-project students within the school, within the 
system and within the province? 

3. Did the curriculum offered to project students adhere to the 
curriculum requirements of Alberta Education? 

4. To what extent was time removed as a requirement for obtaining 
credit? 

5. To what extent was competency established as the requirement 
for obtaining credit? 

6. Were the alternatives to the time credit relationship as 
implemented in Project Schools educationally and financially 
sound? 

7. In what way and to what extent was instruction personalized 
for project students? 

8. In what viay and to what extent was student progress conti- 
nuous? 

9. Were teachers provided with appropriate resources, develop- 
mental activities, guidance and support in order to implement 
the project?^ 
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The study was limited to students, teachers and administrators in 
the three project schools, William Aberhart, John Diefenbaker, and 
Ernest Manning, and to students and teachers in the control 
groups , one at John Diefenbaker , the other at Sir Winston 
Churchill. In addition, the mean scores of all Calgary Board of 
Education students and all Province of Alberta students were used 
for comparison purposes in appropriate courses. 

Evaluation activities, whether formative or summative, were of 
three main types, as follows: 

1. Academic Evaluation 

The evaluation of student achievement levels in Project ABC 
provided tritieal data regarding student success in the 
project compared with regular programs. It was necessary to 
substantiate the belief of project staff that students would 
be at least as successful, if not more so, than regular 
program students. Therefore, final grades were compared, 
whether they were teacher-based or blended (as in the case of 
Grade 12 courses where Diploma Examinations provide 50% and 
teachers the other 50^). Control groups varied from model to 
model, but all project students* final grades were compared 
with Calgary Board of Education and Province of Alberta mean 
grades to determine if significant differences existed. 

2. Attitudinal Evaluation 

Of equal importance, was the need to know if project partici- 
pants' attitudes reflected greater satisfaction than those of 
control groups if individual learning styles and learning 
rates were acknowledged. To this end, a set of questionnaires 
was developed which employed a Likert-type scale and measured 
attitudes towards and perceptions about the project. These 
were administered annually or semi-annually to project and 
control students, project and control teachers and project 
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administrators. Comparisons were made within each model and 
between model groups and their control groups to determine if 
significant differences 'n attitudes and perceptions existed. 

3. Contextual Evaluation 

A flexible third compDnent was built into the study co allow a 
quick reaction to changing project needs. A variety of annual 
contextual activities included such things as classroom obser- 
vation, curriculum validation by Alberta Education curriculum 
consultants, and a budget review. However, probably the most 
critical annual contextual activity was the i.iterview process 
involving a sample of project participants. As the study 
progressed, this responsive mechanism became more and more 
important. 

Contextual activities which evolved out of project needs 
included the examination of time on task a. Diefenbaker in 
1984-1985 and the collection of student tracking data at 
Aberhart and Manning from 1985-1987. 

In order to shed light on the multiplicity of goals, objectives, 
research questions and key concepts engendered by this project, a 
table has been prepared to identify congruence or the lack of it 
among goal topics as perceived by different stakeholder groups. 
(Consult Table 1.) The table also identifies whether the five 
Formative Evaluation Reports or this Summative Evaluation Report 
addresses each topic. 

The table highlights the schools* focus on the concepts of 
personalized instruction and continuous progress in contrast to 
the Steering Committee's main focus on student achievement, 
curriculum adherence, removal of time as a credit requirement and 
its replacement with competency as the basis for awarding credit. 
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EVALUATION GOALS FOR PROJECT ABC 
BY STAKEHOLDER GROUP 



GOAL TOPIC 



PROJECT OBJECTIVES 
(Project Proposal) 



EVALUATION GOALS 
(Steering Committee) 



RESEARCH QUESTIONS 
(Researcher) 



KEY CONCEPTS 



STUDY OUTPUT 



Purpose 



Student 
Achievement 



To provide selected stu- 
dents in three Calgary 
high schools with alter- 
native delivery systems 
to the traditional time 
for credit model, for a 
five-year period. 



To assess the success of 
project schools in pro- 
viding students with 
acceptable alternatives 
to the time '^redit rela- 
tionship expressed in the 
current Junior and Senior 
High School Handbook 
where: 



a) The student achieve- 
ment level is as good 
as or better than 
achievement levels in 
both local and prov- 
incial programs. 



Were the alternatives to 
the time credit relation- 
ship as implemented in 
project schools educa- 
tionally and financially 
sound? 



What changes occurred 
in the achievement of 
project students 
during the course of 
the project? 

How did achievement 
levels of project 
students compare with 
those of non-project 
students within the 
local system and 
within the province? 



Summative Report 



to 



Formative 
Reports 1-5 
SLunnative Report 
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EVALUATION GOALS FOR PROJECT ABC 
BY STAKEHOLDER GROUP (continued) 



GOAL TOPIC 



PROJECT OBJECTIVES 
(Project Proposal) 



EVALUATION GOALS 
(Steering Committee) 



RESEARCH QUESTIONS 
(Researcher) 



KEY CONCEPTS 



STUDY OUTPUT 



Curriculum 
Adherence 



b) The Alberta Curri- 
culum Is adhered to. 
To provide Alberta 
Education with infor- 
mation regarding 
adherence to the 
Alberta Curriculum in 
project schools. 



Did the cur r i cu lum o f - 
fered to project students 
adhere to the curriculum 
requirements of Alberta 
Education? 



Content match 
Standards comparability 



Formative 
Reports 1-5 
Sujnroatlve Report 



I 

to 

Sioanative Report 0& 
I 



Removal of Time 
as a Credit 
Requirement 



c) Time has been removed 
as a requirement in 
awarding credit. 



To what extent was time 
removed as a requirement 
for obtaining credit? 



Stop mechanism 

Learning rate compatible 

with ability 
Flexible entrance to next 

course level 



Coffipetency as 
Basis for Award- 
ing Credit 



d ) Competency has been 
made the basis for 
awarding credit. 



To what extent was compe- 
tency establ ished as the 
requirement for obtaining 
credit? 



Test use at the unit 
level 

Demonstrated competence 
before proceed ing to 
the next unit 

Advancement based on 
competency, not time 



Summative Report 



TABLE 1 

EVALUATION GOALS FOR PROJECT ABC 
BY STAKEHOLDER GROUP (continued) 



GOAL TOPIC 



Personalized 
Instruction and 
Continuous 
Progress 



Administrative 
Procedures 



PROJECT OBJECTIVES 
(Project Proposal) 



1. To develop and pro- 
vide curriculum at 
the senior high 
school level which is 
based on the princi- 
ples of personalized 
instruction and con- 
tinuous progress. 

2. To provide staff 
involved in the pro- 
ject with opportunity 
to acquire knowledge 
and develop expertise 
in the instructional 
application of per- 
sonalized learning 
systems and continu- 
ous progress. 

3- To develop and/or 
adapt instructional 
materials to provide 
students with per- 
sonalized learning 
experiences and tests 
to measure those 
experiences. 



EVALUATION GOALS 
(Steering Committee) 



RESEARCH QUESTIONS 
(Researcher) 



KEY CONCEPTS 



To provide project 
schools with information 
concerning students' 
educational experiences 
in terms of the princi- 
ples of personalized 
instruction and continu- 
ous progress. 



2. 



To Nhat extent and in 
what ways was 
instruction person- 
alized for project 
students? 

To what extent '"•^d in 
what ways was SL.dent 
progress continuous? 



To develop and maintain 
administrative procedures 
to manage the learning 
process, monitor student 
progress , keep records , 
and report credits re- 
ceived. 



Personalized Instruction: 
a) Placement appropriate 
to learning style 
Varied learning envi- 
ronments 
Stop mechanism 
Demonstrated compe- 
tence of each unit in 
a course before pro- 
ceeding to the next 
unit 

Opportunities for 
enrichment 



b) 

c) 
d) 



e) 



Continuous Progress: 

a) A learning rate com- 
patible with ability 

b) Flexible timetabling 
to accommodate perso- 
nal choice or need 

c) Advancement based on 
competency rather 
than time spent 



STUDY OUTPUT 



Formative 
Reports 1-5 



to 



Formative 
Reports 1-5 
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EVALUATION COALS FOR PROJECT ABC 
BY STAKEHOLIER CROUP (continued) 



COAL TOPIC 



Teacher Support 



PROJECT OBJECTIVES 
(Project Proposal) 



EVALUATION COALS 
(Steering Connittee) 



RESEARCH QUESTIONS 
(Researcier) 



KEY CONCEPTS 



STUDY OUTPUT 



Were teachers provided 
wi th appropriate re- 
sources i developmental 
activities, guidance and 
support In order to 
Implement the project? 



Formative 
Reports 1-5 



Project 
Evaluation 



To Incorporate an ongoing 
evaluative component Into 
the project in order to 
provide both annual for- 
mative evaluation Infor- 
mation as feedback Into 
the planning process, and 
also a sunroatlve evalua- 
tion report at the end of 
the five-year period to 
measure the success of 
the project. 



Formative 

Reports 1-5 ^ 
Suiomatlvc Report u> 



Province-wide 
Application 



To provide Alberta Educa- 
tion with Information 
regarding alternatives to 
time for credit for use 
in the consideration of 
province-wide application 
of these alternatives. 



To provide Alberta Educa- 
tion with information for 
use In the consideration 
of province-wide applica- 
tion of Project ABC-type 
programs. 



Summatlvc Report 
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The broader terms of personalized instruction and continuous 
progress were addressed in the five Formative Evaluation Reports 
in order to provide feedback to the schools, while the more 
specific variables of time use and demonstrated competence were 
reserved ^or this final report to Alberta Education. 

The remainder of this chapter will outline the design and method- 
ology employed in both formative and sununative evaluation activi- 
ties and will close with a note about the policy Delp»u study and 
discussion of problems and limitations encountered in the study. 

Formative Evaluation 

The five annual Formative Evaluation Reports provided feedback to 
the project schools on student achievement, curriculum adherence, 
personalized instruction, continuous progress, administrative 
procedures and teacher support. 

The methodology employed in the formative evaluation with regard 
to sampling procedures, control groups, design, data collection 
and data analysis is outlined below. 

Sampling Procedures 

Student participants in the study were selected annually according 
to the nature of the model employed by each of the project 
schools. As a result, each population was handled somewhat 
differently as is outlined below. 

Department-based Model All Grade 11 and Grade 12 students 

who had completed two Business Educa- 
tion courses in Grade 10 and who were 
currently enrolled in at least one 
Business Education course. 

Similar Control group selection.^ 
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Parallel Core Program Model All students i gistered in PEP in 

Grade 10. 

Control group selection , also in 
Grade 10, based on course registra- 
tion patterns similar to those of PEP 
s^.udents. 

School-wide Model All registrants in courses selected 

according to the school timetable. 

No control group. 

Interviews were conducted annually with a 10-20f. sample of project 
students registered in the second semester. 

All teachers of the above students were surveyed annually with 
attitude questionnaires and teachers of project students were also 
interviewed. Senior administrators, program heads and guidance 
counsellors in project schools were surveyed annually. Senior 
administrators and program heads were also interviewed annually. 

Initially, parents were included as a respondent group but after 
one year of the project they were deleted due to both the paucity 
of information gained and their low response rates. 

Control Groups 

Again, control groups varied from model to model. Sir Winston 
Churchill High School (Calgary) was selected to provide control 
groups of Business Education students because, in the view of 
Aberhart staff, the school served a comparable population and 
provided what might be termed a traditional Business Education 
program. 

Students who were not in the project provided control groups at 
Diefenbaker. Staff felt that this would supply the most useful 
data L oause the school environment was identical and tests used 
by teachers were the same for both groups. 
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At Manning, initially, there was an attempt to identify both 
project and control students but by the fourth year of the project 
the definition of PACE had been broadened to include all students 
in the school and so the control group concept was eliminated. 

In addition, as mentioned above, all Calgary Board of Education 
and Province of Alberta students were employed to provide mean 
scores for academic comparisons. 

Design 

The nature of each model necessitated the development of a differ- 
ent evaluation design. (Consult Table 2.) 

In the Department-based Model, once the sample was selected, a 
baseline comparison of students' final grades was conducted to 
establish if differences existed between project and control 
groups. In all, four groups of students were examined in the 
project. 

In the Parallel Core Program Model an attempt was made to collect 
some baseline data about project and control students through a 
comparison of their results on the Grade 9 city-wide tests used by 
the Calgary Board of Education. Unfortunately, after one year of 
the project these tests were deleted. In all, three groups of 
project and control students were tracked throughout their three 
years of high school. 

The School-wide Model was by far the largest of the three models 
and not surprisingly took the longest to get underway. Although a 
few isolated courses were examined in 1982-1983, it was not until 
.981-1985 that a full complement of courses at the Grade 10 level 
was available for examination. Only this group could be tracked 
to completion of Grade 12 by 1987, although another group was 
tracked to the end of Grade 1 1 . 
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TABLE 2 
MODEL-BASED DESIGN OF FORMATIVE EVALUATION 
PROJECT ABC 
1982-1987 



YEAR 


0 


1 


2 


3 


4 


5 






(Pilot) 










MODEL 


1981-82 


1982-83 


1983-04 


1 984-83 




lQAfi-A7 

1 ?oo 0/ 


UtrAK 1 MtN I —onobu 


Basel ine 


GKOUr 1 


GROUP 1 












(Grade 


(Grade 












11) 


12) 












Base 1 i ne 


bROUr 2 


GROUP 2 












(Grade 


(Grsde 












11) 


12) 












Basel i ne 


GROUP 3 


GROUP 3 












(Grade 


(Grade 












11). 


12) 












Basel ine 


GROUP 4 


GROUP 4 












(Grade 


(Grade 












1 1 ) 


12) 


PARALLEL CORE 


Basel ine 


GROUP 1 


GROUP 1 


GROUP 1 






ppfV^pAM MOTIF 1 




(Grade 


(braae 


(Grade 












1 1 \ 
1 1 ) 


12) 












GROUP 2 


GROUP 2 


GROUP 2 










(Grode 


(Grade 


(Grade 










10) 


11) 


12) 












GROUP 3 


GROUP 3 


GROUP 3 










(Grade 


(Grade 


(Grade 










10) 


11) 


12) 


SCHOOL-WIDE 






GROUP 1 


GROUP 1 


GROUP 1 




MODEL 






(Math & 


(Math I 


(Math i 










Typing) 


Typing) 


Typing) 












GROUP 2 


GROUP 2 


GROUP 2 










(Grade 


(Grade 


(Grade 










10) 


11) 


12) 












GROUP 3 


GROUP 3 












(Grade 


(Grade 












10) 


11) 
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Instrumentation 



The questionnaire format in the first year of the project was 
different for each of the respondent groups, as the following 
topic list indicates: 



Student Questionnaire 



Parent Questionnaire 



Teacher Questionnaire 



General Information 

lAR Scale (Intellectual Achievement 

Responsibility Scale) 

Learning Activities Description 

Student Satisfaction Scale 

General Information 

Learning Activities Description 

Parent Satisfaction Scale 

General Information 
Concerns Questionnaire (CBAM) 
Learning Activities Description 
Teacher Facet Satisfaction Scale 



Administrator Questionnaire General Information 

Administrator Rating Scale 



A number of factors provided impetus for revising the instruments. 
The severe time constraints under which the instruments had been 
developed had limited pre-testing. Feedback from respondents 
tended to be negative. Analysis and compilation of results proved 
to be very difficult. It was the view that information collected 
was too diffuse. 



Therefore, the Steering Committee decided that the first year of 
the evaluation be designated a pilot study. The instruments were 
then subjected to stringent factor and content analysis. In 
addition, by this time, the evaluation goals had been finalized. 
And so it was possible to develop a Data Collection Matrix and a 
set of questionnaires which were coded for cross-referencing and 
interpretation ease. (Consult Table 3.) This matrix then pro- 
vided the structure for the remainder of the formative evaluation 
with the addition of two items related to student interaction in 
1985 at the request of a Calgary Board of Education trustee. 
(Samples of the revised instruments are available in Appendix 5.) 
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TABLE 3^ 
DATA COLLECTION MATRIX, FORMATIVE EVALUATION 
PROJECT ABC 
1982-1987 



DATA NEEDS 


DATA SOURCE 


1.00 Achievement Levels 

1.10 Achievement Data 

1.20 Satisfaction with 
Achievement 


Final Grades - Project, City, 
Province 


2.00 Coverage of Alberta 
Curriculum 

2.10 Staff Satisfaccion 
with Coverage of 
Alberta Carriculam 

2.20 Alberta Education 
Curriculum Evalua- 
tion Reports 


Curriculum Evaluation Report 
Albe>"ta Education Consultants 


3.00 Removal of Time 
Requirement 

3.10 Conpetency as the 
Criterion for 
Awarding Credit 


Deleted - see 5.30 and 4.40 


4.00 Personalized Learning 
Alternative 

4.10 Placement Appro- 
priate to Learning 
Style 


Questionnaires - Students, 
Teachers, Administrators 

Interviews - Students, 
Teachers, Administrators 

On-site Observation 
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T A B L 


E 3 


DATA COLLECTION MATRIX, FORMATIVE EVALUATION (continued) 


PROJECT ABC 


1982-1987 




DATA NEEDS 


DATA SOURCE 




^.00 Personalized Learning 
Alternative (continued) 


Questionnaires - Students, 
Teachers, Administrators 




4.20 Varied Learning 
Environments 






4.30 Stop Mechanism 

4.40 Demonstrated 
Competence for 
Each Unit 


Interviews - Students, 
Teachers , Admin is trators 

On-site Observation 




4.41 Test Use 

4.42 Competence 
Demonstrated 
Before Proceed- 
ing to Next Unit 






4.50 Enrichment 

Opportunities 






5.00 Continuous Progress 
Alternative 


Questionnaires - Students, 
Teachers , Administrators 




5.10 Learning Rate Compa- 
tible with Ability 


Interviews - Students, 
Teachers, Administrators 




D.dO Flexible 

Timetabling 

5.21 Flexible 
Entrance to Next 
Course Level 

5.22 Flexible Day 


On-site Observation, 
Attendance at School 
Meetings, Review of School 
Records, etc. 




5.30 Advancement Based 
on Competency, 
Not Time 
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TABLE 3 

DATA COLLECTION MATRIX, FORMATIVE EVALUATION (continued) 

PROJECT ABC 
1982-1987 



DATA NEEDS 


DATA SOURCE 


6.00 Affective Response 
to Project 


Questionnaires - Students, 
Teachers, Administrators 


6.'iO Satisfaction 
(Student) 


Interviews - Students, 
Teachers , Administrators 


6.11 With Organiza- 
tion of Program 

6. 12 With Challenge 
for Students 

*6.13 With Numbe- of 
Students Known 


On-site Observation, 
Informal Meetings, etc. 


6.20 Satisfaction 
(Teacher) 




6.21 Sense of 
Achievement 

6.22 Recognition 

6.23 Staff Morale 




6.30 Satisfaction 

(Administrator) 




6.40 Communications 




6.41 Teacher-Student 

6.42 Teacher Interest 
in Students 

6.43 School-wide 
Communication 
(Teacher) 




*Added in 1985 
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TABLE 3 

DATA COLLECTION MATRIX, FORMATIVE EVALUATION (continued) 

PROJECT ABC 
1982-1987 



DATA NEEDS 


DATA SOURCE 


6,00 Affective Response to 
Project ( con t i nued ) 

6.40 Communications 
(continued) 

6.44 Communications 
about ABC 
(Administrator) 

6.45 Teacher-Teacher 
*6.46 Student-Student 




7-00 Resource Use 
7.10 Money 

7.11 Materials 

7.12 Library 
Resources 

7. 13 Aides 

7.14 Equipment 

7.20 Time 

7.21 Preparation Time 
7.2^ Release Time 

^ Added in 1983 


Questionnaires - Students, 
Teachers, Administrators 

Interviews, Students, 
Teachers, Administrators 

Budget Review - Review of 
Documents, Interview with 
Project Director 
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Due to an administrative decision at Sir Winston Churchil] High 
School in 1983, several critical items related to personalized 
instruction and continuous progress were deleted from their 
versions of the questionnaires. This weaken*3d the value of their 
contribution as a control group and necessitated the development 
of a special abbreviated set of questionnaires for administration 
in that school . 

Model-specific interview formats were developed on an annual basis 
according to issues identified in the analysis of questionnaire 
results. This process is elaborated below. 

A course evaluation format was developed for Alberta Education 
consultants in their role as validators of project coverage of the 
Alberta curriculum. Two questions were posed for each course, as 
follows: 

1. Does the content of this course match the Program of 
Studies for Senior high School? 

2. Are the standards applied in this course comparable to 
those applied generally across the province? 

The consultants reviewed each of the project courses annually and 
submitted their evaluations. 

Data Collection 

For the purposes of academic evaluation, the mean scores for 
project, control and system students were collected annually with 
the assistance of Computing Services, Calgary Board of Education 
with a specially designed program which searched students* cumula- 
tive records for appropriate course scores. Mean scores for 
Province of Alberta students were collected with the assistance of 
Computer Services, Alberta Education with a similar specially- 
designed program to retrieve and calculate final mean grades. 
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For the attitudinal evaluation component, questionnaires were 
administered to students at Aberhart, Churchill and Manning on a 
semester basis in order to poll all appropriate course registrants 
in each sample. As Diefenbaker is a non-semestered school, ques- 
tionnaires were administered in the second semester each year. At 
that time, teacher and administrator questionnaires were also 
administered to study participants. Over the life of the project, 
a total of 7,953 questionnaires were completed and returned, 
(Consult Table 4,) 

A sequential data collection process was developed to enrich study 
findings, (Consult Figure 1,) Once the questionnaires were 
analyzed and significant differences among respondent groups 
determined, model-specific issues were identified which required 
clarification. These issues became the basis of interview 
questions, again model-specific. Each set of interviews was 
analyzed before questions were formulated for the next set so that 
it was possible to sharpen the focus on issues and in some cases 
clarify them completely, 

A number of contextual evaluation activities took place annually. 
Alberta Education consultants validated the curriculum annually. 
Courses which received scrutiny varied with the model and year, 
(Consult Table 5.) 

The annual budget review was conducted by means of a document 
review and a meeting with the Project Director, He prepared an 
annual budget of proposed and actual expenditures on a school-by- 
school basis and also produced an updated summary budget by year 
and category. 
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TABLE 4 



QUESTIONNAIRE RESPONDENTS 
PROJECT ABC 
1982-1987 



MODEL AND GROUP 


1982-83 


19S>84 


1984-85 


1985-86 


1986-87 


TOTAL 


utrAKI icNI'-bAbbU 














iui/\r\r"i 

^X}UEL 
















1 1 s 


9 1 0 


1 0 1 


1 1 o 


Zj 




Students (C) 


109 


240 


225 


169 


44 




Teachers (P) 


7 


6 


6 


5 


5 




i COV« liCl ^ V / 




in 




•7 
/ 


5 




Admin Istrators 


3 


6 


6 


6 


4 




Parents 


43 














286 


481 


367 


305 


81 


1520 


rAKALLcL COKt 














PROGRAM MODEL 














Students (P) 


90 


142 


192 


1 1 s 






Students (C) 


98 


157 


199 


101 


29 




Teachers (r^) 


6 


8 


10 


8 


1 1 




Teachers (C) 


4 


5 


9 


8 


9 




Administrators 


7 


6 


8 


8 


6 




Parents 


55 












260 


318^ 


418 


240 


112 


1348 


SCHOOL-WIDE 














MODEL 














Students (P) 


544 


417 


792 


1004 


1587 




Students (C) 






579 








Teachers (P) 


35 




12 


11 


14 




Teachers (C) 












Admin istrators 


10 


4 


12 


11 


12 




Parents 


33 












622 


429 


1395 


1026 


1613 


5085 


TOTAL 


1168 


1228 


2180 


1571 


1806 


7953 



KEY - (P) Project Group 
- (C) Control Group 



ERIC 



6G 



- 43 - 



\ 



ATTITUDINAL QUESTIONNAIRES 



ANALYSIS 



IDENTIFICATION OF ITEMS WITH 
SIGNIFICANT DIFFERENCES 



ANALYSIS 



INTERVIEWS - STUDENTS 



ANALYSIS 



INTERVIEWS - TEACHERS 



ANA.LYSIS 

INTERVIEWS -/ 
ADMINIS- 
TRATORS / 

\ / 



/ 



ISSUE CLARIFICATION 



FIGURE 1 



SEQUENTIAL DATA COLLECTION PROCESS 
FOR ISSUE CLARIFICATION 



PROJECT ABC 
1982-1987 
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TABLE 5 
COURSES VALIDATED BY ALBERTA EDUCATION 
CURRICULUM CONSULTANTS, PROJECT ABC 
1982-1987 



MODEL 



DEPARTMENT- 
BASED MODEL 



1982-83 



PARALLEL CORE 
PROGRAM MODEL 



Taping 20, 

Accounting 
20, 30 ^ 
Law 20, 30 
Data Pro- 
cessing 20 



1983-84 



SCHOOL-WIDE 
MODEL 



ERLC 



Homan i t ies 



Mathematics 



Taping 20, 

Account inq 

20, 30 
Law 20, 30 
Business 
Procedures 

20 
Office 
Procedures 

30 

Business 
Machines 30 



1984-85 



Sc ience 



Human i t ies 
10, 13, 
20, 23 

Math 10, 
)3, 15 
20, 23 25 



Math 10, 
13 



Typing 10, 

20, 30 
Account ing 

10, 20 

law 20 
Computer 
Processing 
10 



Typing 20, 

So 

Account inq 
20, 30 

Low 20, 30 

Office 

Procedures 
20, 30 

Business 

Commun I ca- 
tions 20 

Business 

Calcula- 
tions 20 



Human tttes 

10, 13, 

20, 23 

30; 33 
Math 10, 

13, 20 

23; 30; 33 
Biology 10 

20, 30 
Chemistry 

10, 20, 30 
Pf^ysics 10 

20, 30 
Science 35 



1985-86 



Taping 20, 

Account inq 

20, 30 
Law 20, 30 



1986-87 



Typing 30 

Account inq 
30 ^ 
Law 30 



Mdth 10, 
J3, 20, 23 

Engl ish 
10, li 



»oc i a I 
Studies 
10 

Biology 
10 

C .»*?try 

Physics 
10 

Typing 

20, 30 
Account inq 

10, 20 ^ 

Drafting 
12 ^ 

But I ding 

Construc- 
tion 12 

Mechanics 

12 



Human 1 ties 
20, 23, 
30, 33 

Mathenat ies 

20, 23, 

30; 33 
Biology 

20,30 
Chemistry 

20, 30 
Physics 

20, 30 



Math 10, 

Engl ish 10 
13, 20, 23 



Soda I 
Studies 
10, 20 

Biology 
10, 20 

Chemistry 
10, 20 

Physics 
10, 20 

Typing 10, 

20, 30 
Account inq 

10, 20 

Food Stu- 
dies 10/20 

Psychology 
20 

Art 10, 
20, 30 

Visual 

Commun I ca- 
tion 12 

CcTmerc iai 

Art 15, 

25a, 25b, 
25c 



Humanities 
30, 33 



Math 30, 
33 

Biology 
30 

Chem* btry 

30 
Phys t CS 

30 



Math 10, 
13, 20 
II. 30. 

Engl ish 
10, 13, 
20, 23 
30, 33 

Soc I a I 

Studies 

!§• 

Biology 

Chemistry 

Physics 

Typing 10, 

20, 30 
Accounting 

iO, 20, 

Physical 
Educat if 
10 
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In the third year of the project an informal survey was conducted 
of Parallel Core Program students at the request of the school in 
order to see how students were using their in-school time. For a 
three-month period, randomly selected Teacher Advisor groups 
recorded their actual time spent on project courses during school 
hours. Despite the limitations of self-reported data and low 
response rates in certain cases, enough data were generated to 
give an indication of the degree of time-on-task variability. 

During the last two years of the project, student completion 
patterns were recorded for the Department-based and School-wide 
models. Figures were kept for students in three categories, as 
follows : 

1. Stuctints who completed courses in less than one semester. 

2. Students who took a full semester to complete courses. 

3. Students who needed more than one semester to complete 
courses. 



Data Analysis 

For the academic evaluation component of annual activities, mean 
scores of project students were compared with the mean scores of 
control groups through the use of the t-test. Significant differ- 
ences were identified at the .05 level. A primary evaluation goal 
was that student achievement in Project ABC be as good as or 
better than achievement levels locally and provincially . The 
absence of significant differences sugge^-ed that academic 
achievement was not affected by the educational model employed in 
the project. Scores which were significantly higher in project 
courses suggested that a positive impact was being experienced by 
students as a result of the project model. Scores which were 
significantly lower in project courses suggested that the model 
was having a deleterious effect on student achievement. 
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The comparisons varied from model to model but, generally, the 
following categories of mean scores were compared: 

Model students* mean scores with Calgary Board of Education 
students* mean scores 

Model students* "lean scores with Province of Alberta students' 
mean scores 

For analysis of the attitudinal component, questionnaires were 
analyzed with the SPSS program Cross-tabs to determine if signifi- 
cant differences in perceptions existed between the following 
respondent groups: 

1. Project students and control group of students (where 
appropriate) , 

2. Project teachers and control group of teachers (where 
appropriate) . 

3. Project students and project teachers. 

4. Project teachers and school administrators. 

5. Project students, project teacherj and school adminis- 
trators. 

Significant differences in perception were identified at the ,05 
level with the use of Chi-square to determine whether the varia- 
bles were independent or related and Cramer's V to measure the 
strength of the relationship. 

Both of these statistical activities were greatly supported by the 
assistance of the Program Evaluation Section, Calgary Board of 
Education. 

Interview data were analyzed using traditional content analysis 
methods as outlined below :^ 



1. Development of Categories (a) 

(b) 
(c) 



responses unitized; 
responses coded by group; 
responses sorted by question 
number; 
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(d) 



categories determined for each 
question ; 

responses sorted into catego- 
ries. 



(e) 



2- Summary of Responses 



(a) 
(b) 
(c) 
(d) 
(e) 



category descriptors developed; 
similar responses compiled; 



similar responses paraphrased; 
unique responses edited; 



summary of responses for each 
question prepared. 



Summative Evaluation 

The purpose of this Summative Evaluation Report is twofold: 1) to 
assess the success of project schools in providing students v/ith 
acceptable alternatives to traditional time credit relationships 
in terms of student achievement, curriculum adherence, removal of 
time as a credit requirement and implementation of competency as 
the basis of avjarding credit; and 2) to provide Alberta Educacion 
with information for use in the consideration of province-wide 
applications of alternatives to time credit. The methodology 
employed in this summative evaluation with regard to sampling 
procedures, control groups, design, data collection and data 
analysis is outlined below. 

Sampling Procedures 

For the final analysis of Project ABC, represented by this volume, 
an attempt was made to extract critical variables from the 
enormous wealth of data generated over five years. While forma- 
tive data provided a useful communication function for project 
participants, summative data were extracted and analyzed to 
provide conclusions at the system and provincial levels. 

The academic evaluation component of summative activities was 
limited to the mean scores of project students in 30-level courses 
as they best reflected project outcomes. 
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The attitudinal evaluation was limited to the responses of project 
students on the six critical variables most closely linked to 
project evaluation goals. Teacher and administrator data provided 
a useful context for analysis of student data but numbers we*^e too 
small to warrant statistical analysis. 



Control Groups 



Control groups for the academic evaluation were limited to the 
system-wide and province-wide groups of students who provided mean 
scores for appropriate courses. Individual models* control groups 
were eliminated from the statistical analysis although they conti- 
nued to provide a useful context. 

No control groups were used for the attitudinal evaluation. 
Instead, attitudes and perceptions of students in each of the 
three models were compared. 



Design 



From the "macro" perspective of a summative stance, model differ- 
ences diminished in the x'ace uf the question, "Do alternatives to 
time-credit work?" Therefore all project data were treated iden- 
tically. 



Academic evaluation activities related only to the results of 30- 
level courses. Attitudinal evaluation activit^'es related to six 
critical variables extracted from the student questionnaire. The 
six variables divided into two key topics as follows: 



1. Time Use Flexibilitv 



(a) 
(b) 



(c) 



Demonstration of Competence (a) 

(b) 



use of a stop mechanism; 
provision of flexible 
ent»" \nce to the next level 
of < "iourse; 

course learning pace compa- 
tible with student ability. 

use of tests at the unit 
level; 

demonstration of corr.petence 
at the unit level before 
proceeding; 
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(c) advancement to the next 
course based on student 
competency, not time spent. 

A major contextual evaluation activity which occurred in 1987 was 
the design and implementation of a policy Delphi study which had a 
panel of 23 project teachers and administrators. Over a three- 
month period three rounds of questionnaires were designed, disse- 
minated, collect 3d and tabulated on the topic of project outcomes. 
The study was completed within five months with a 95/5 retention 
rate. Although the study is reported elsewhere, ^ the data which it 
provided have proved to be a rich source of contextual data of a 
summative nature and are referred to throughout this report where 
appropriate. 

Instrumentation 

Mo new instruments were developed for summative activities apart 
from those generated in the policy Delphi study referred to above. 

Data Collection 

No ew statistical data were required for the project-wide evalua- 
tion activities reported here. However, contextual activities 
provided the opportunity to develop some summative inquiry 
methods. In the final years of participant interviews, a number 
of questions were formulated of a summative nature. 

For example, project teachers were asked, "How has teaching in 
Project ABC influenced your teaching style?" 

Curriculum consultants from Alberta Education were asked to 
comment on two summative questions regarding each course reviewed, 
in addition to the two formative ones. These summative questions 
were as follows: 

\. Are the methodological approaches used in this course educa- 
tionally sound? 
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2. Could this course (or program) be offered iti a similar manner 
in another school in Alberta? What critical factors would 
have to be taken into account? 

The policy Delphi provided valuable information on the foli-^wing 
topics: 

1. Essential components of an alternative to time-credit program. 

2. Project benefits and drawbacks. 

3. Project teacher characteristics. 

4 . Outstanding issues. 

Data Analysis 

A great deal of data in this study was available for quantitative 
analysis. In particular, two sets of data weie treated including 
student , teacher and administrator perceptions on key study 
variables and student achievement data for project, city and 
province-wide mean scores. Procedures are outlined below. 

PERCEPTUAL DATA 

Descriptive statistics were prepared for student, teacher and 
administrator perceptions of key variables by extracting data from 
the attitudinal questionnaires administered from 1983 to 198? . 
Due to small sample size, no analysis of variance was conducted 
for teacher or administrator data. However, student perceptions 
were subjected to univariate analysis of variance with year as a 
factor to determine change over time within each school. Then 
differences between schools during the last year of the project 
were also examined. 

The analysis was conducted using the Statistical Package for the 
Social Sciences (SPSS) procedure entitled ONEWAY, an analysis of 
variance procedure which includes post hoc testing. This 
procedure was selected rather than ANOVA which does not include a 
post hoc test. 
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The post hoc comparison was carried out using the Scheffe test (an 
example of a range test) for the purpose of comparing several 
vari?'^les. The search was for any significant differences between 
all possible g-oup pairs of means. The Scheffe procedure was 
utilized because it is a -ommon and conservative test to use when 
there are unequal group sizes as was the case in this study with 
three different sized student populations in the three Project 
schools . 

If the F probability was <.05, it was considered a significant 
difference and thus the post hoc procedure was carried out to 
determine between which school or year the significant difference 
existed. It was necessary to return to the tables of means to 
determine the direction of change. 

ACHIEVEMEMT OATA 

Descriptive statistics were prepared for 30-level courses com- 
pleted by project students from 1983 to I987. Similar data were 
compiled for all students in the Calgary Board of Education who 
had completed the same courses in the same years and similarly for 
all students in the Province of Alberta. 

A univariate analysis of variance was conducted with year as a 
factor to determine change over time within each school. Then 
project student achievement levels were compared with those of the 
city and the province, within each year as appropriate. 

The procedure employed was the new SPSS-X ONEWAY analysis of 
variance with the post hoc comparison conducted by using the 
Scheffe test. If the F probability was <.05, the post hoc 
procedure was conducted to further clarify if significant 
differences existed. The conservative nature of the Scheffe test 
was deemed appropriate because of the very large differences in 
group sizes. 
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The Delphi Study 

As part of the final year of evaluative activities in Project ABC, 
a policy Delphi study was designed to capture some of the more 
informal information and perceptions which would not emerge from 
other more structured summative activities . The Delphi allowed 
participants from each of the three schools to probe complex 
issues anonymously over a period of time. 

The policy Delphi method was chosen as the research technique for 
the following reasons: 

1. Solicits information by open-ended questiohi>. 

2. Accommodates the busy schedules of teachers and provides time 
to contemplate answers. 

3- Provides a mechanism for respondents to comment on one 
another's comments and suggestions. 

4. Maintains anonymity. 

5. Allows opinions and issues to be clarified ir a cyclical 
process. 

A pane] of 21 teachers and administrators took part in the three 
rounds of the study. The retention rate of panelists was 95% > 
The study was completed in the first five months of 1987. The 
process proved to be effective in providing invaluable information 
of a contextual nature regarding Project ABC. Findings are 
reported in Chapter 5. 

Problems 

Inevitably in a project of this magnitude and length, certain 
problems are encountered. These are outlined on the following 
pages . 
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1. Pilot Year 

Although the project officially began in September 1982, 
contractual concerns between Alberta Education and the Calgary 
Board of Education slowed the development process and the 
evaluation was not actually initiated until November or 
December of that year. Evaluation goals were not finalized 
until the Spring of 1983 . The decision to consider that first 
yeir as a pilot study was a vii-^e one as the ensuing instru- 
ments were much stronger, but a year of attitudinal data was 
essentially lost in the process. 

2. Two Levels of Goals 

As outlined in Chapter 1, the project evolved with provincial 
goals focusing on alternatives to the Carnegie Unit while 
individual schools were focusing on ways to meet the needs of 
students , particularly dysfunctional ones , through personal- 
ized instruction and continuous progress. The two levels of 
goals which thus developed were bound to generate a certain 
amount of conflict. The school-level goals were viewed by 
staff with more immediacy than the provincial level goals, 
while the provincial-level goals tended to influence the 
development of evaluation goals, negotiated at the Steering 
Committee. Thus on occasion, the evaluation was viewed as 
serving provincial needs rather than local ones. Over time, 
howeve^, the conflict disappeared as both sets of goals became 
more attainable and as the contextual component of the evalua- 
tion developed to address each school's specific needs. 

3. Three Models 

Again, due to the method of project initiation, tnree 
disparate models were united in one project. Initial concerns 
and hostility about being "lumped together" declined as the 
normative evaluation process came to examine each model 
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separately and no attempts were made to compare results in the 
light of project goals. Further, the relations among the 
schools improved as it became evident that each had carved out 
a unique program. Eventually more sharing began to occur and 
when confronted with financial cutbacks, a perceived lack of 
support from their peers and an uncertain future, cordiality 
ensued . 

Turnover in the Steering Committee 

By the fifth year of the project only one original Steering 
Committee member remained, apart from the Project Director and 
the external evaluator. Turnover resulted from retirement and 
job changes at both Alberta Education and the Calgary Board of 
Education. All members who served on the committee demonstra- 
ted a high degree of commitment and interest during tneir 
tenure, but a certain longitudinal perspective tended to be 
lost and the project's roots were buried. 

Model-specific Problems 

A number of model-specific problems arose at various points in 
the project as might be expected in a lengthy project with a 
loosely-knit structure. The most serious problems included 
the following: 

Department-based Model Declining enrolments 

Parallel Core Program Model Lack of development of the conti- 
nuous progress component 

School-wide Model Slow program development and lack 

of a game plan 
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Limitations 



In addition, there was a number of limiting factors which emerged 
during the five-year per"od, as follows: 



I. Institution of Diploma Exams 



One year after project initiation, Alberta Education imple- 
mented the Grade 12 Diploma Exams. This had a marked impact 
on Grade 12 project students, in some cases discouraging their 
participation. With the exams set only three times a year, 
continuous progress and, more specifically, continuous exit, 
was not realistic. Further, with the increased emphasis on 
final grcdes, some students were not willing to be part of an 
educational experiment. To a degree. Grade 12 became a 
holding tank situation. However, project teachers turned this 
to advantage by implementing review units which might not have 
been developed otherwise, and this may have had an impact on 
final grades achieved. 



2. Discontinuation of Grade 9 City-wide Exams 



After one year of the project, the Calgary Board of Education 
Grade 9 city-wide exams were discontinued, affecting the basic 
design of the Parallel Core Program evaluation. It was no 
longer possible to make baseline comparisons between project 
and control students prior to high school program entrance. 

3. Diminishing Value of Model-specific Control Groups 

As indicated above, the control group at Sir Winston Churchill 
lost much of its impact when critical questionnaire items were 
removed by the school administration. In addition, over time, 
some crossover tended to occur, and the control group came to 
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approximate the test group in some areas despite basic philo- 
sophical differences. Most noticeable at Churchill was the 
increasing use of unit-level tests. 

In the Parallel Core Program, differences between project and 
control students* perceptions remained strong throughout the 
project, but it was interesting to note organizational changes 
which occurred in the control program because of the project's 
influence (e.g., increased use of the test centre by control 
students, implementation of the Teacher Advisor system school- 
wide) . 

In the Schocl-wide Model, attempts to develop a ^'traditional" 
control group collapsed when the school's definition of PACE 
expanded to encompass al] students in the school. 

And finally, over the five-year period, attitudes toward 
evaluation began to change as more naturalistic, evolutionary 
models became accepted, the black box approach to measuring 
human behavior lost ground, and reliability and ob;ectivity 
became tempered with auditability and conf irmability 

Diminishing Value of Questionnaire in a Longitudinal Study 

While the stringent testing that took place at the end of the 
first year ensured that valid instruments were developed, and 
while repeated significant differences between project and 
control groups confirmed their validity, the instruments still 
reflected perceptions prevalent early iv the study. It is to 
the credit of project teachers and administrators that the 
project evolved far beyond the items on the questionnaires, 
which while still valid, came to be somewhat superficial. 
Fortunately, the contextual component of the study was able to 
expand into project areas which could not be predicted in 
1983. 
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5. Changing Business Education Curriculum 

It seemed for the full five years of the project that the 
Business Education curviculum was in a state of change. This 
was a constant source of frustration for Business Education 
teachers who were trying to write and then maintain individua- 
lized materials. In fact, this situation is only representa- 
tive of what lies ahead for all high school teachers with the 
recent implementation of the Secondary Education Policy 
Statement. 

6. Evaluator Bias 

Being the evaluator of a project for five years is like being 
a project participant. Faces and personalities became very 
familiar, the schools became comfortable places to be. Staff 
members who had been interviewed five years running might not 
be viewed impartially. On the other hand, with familiarity 
came a growth in understanding about project successes and 
frustrations and about model subtleties and complexities which 
might escape a cursory glance. The stringent statistical 
activities conducted at project end have hopefully helped to 
counter evaluator bias, unconscious or otherwise, while 
evaluator understanding has hopefully helped to strengthen 
study conclusions and recommendations. 
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CHAPTER 4 - STUDY FINDINGS FOR EACH MODEL 



In this chapter each model will be reviewed in the following 
manner. First, a description of the school at the beginning of 
the project will be provided along with original school-based 
goals. Next, a description of the school at project end will be 
outlined. Finally, model-specific study findings related bo 
summative e\'aluation goals will be presented. In particular, the 
success of each of the three project models will be assessed with 
regard to their ability to provide students with acceptable 
alternatives to traditional time-credit relationships in terms >f 
student achievement, curriculum adherence, removal of time a.s a 
credit requirement and the implementation of competency as the 
basis for awarding credit. Overall project findings and 
considerations for Alberta Education are reserved for the next 
chapter. 

Department '-based M odel 
Before the Project 

In 197^, William Aberhart High Sc'.iool requested that the Calgary 
Board of Education renovate the Business Education wing of the 
school. At that time, it ccnsistsd of a long hall with doors 
leading off Into classrooms. As the proposal noted: 

The students can be compared to animals entering various 
chutes into their pens. They complete their activity in a 
particular pen then go down ^he long hall through another 
chute into another pen to do another activity.' 

In contrast, modern business offices were wide open, brightly lit 
places where many activities occurred simultaneously. The propo- 
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sal called for increased flexibility and efficiency in program- 
ming, and staff and equipment utilization through the development 
of an open area simulated office setting. The walls between five 
classrooms and the hallway were to be removed, carpet to be 
installed and modern desks to replace the old typing tables. The 
open area would permit a reduction In the number of typewriters 
required, more flexible timetabling ^f courses, team teaching, 
individualized instruction and concinuous progress, although 
credits would have to be awarded at the end of the semester. 

With renovations and the new program approach in place, student 
enrolment in Business Education tende-i to exceed normal Business 
Education enrolment for a school of tnat size (915 students and 53 
teaching staff). At that time, 700 of the school's students took 
some element of the Business Education program.^ This was the 
result of the flexibility afforded by the open area. Nearly all 
Business Education courses were provided on an individual basis 
every period thus accommodating most students' tii..etable require- 
ments. In addition, students were encouraged, albeit unoffi- 
cially, to progress as quickly as possible. Teacher satisfaction 
was high despite the workload because they were able to meet each 
student's problem as it occurred. They enjoyed v^^orking together 
as a team and liked the variety of teaching a number jf courses 
simultaneously . 

In 1981, the Business Education Department saw Project ABC as an 
opportunity to provide teachers with support to enable them to 
translate all their program offerings into unit packs. It would 
allow students to progress at a speed compatible with their abili- 
ty by offering them credits upon mastery. A number of other 
program benefits was foreseen by participation in the project, 
including the following: handling record keeping and tracking 
problems through the use of a clerical aide; acquiring an addi- 
tional photocopier and a microcomputer to assist in materials 
preparation; providing release time for curriculum revision; and 
encouraging staff development through workshops and visits to 
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other schools. It was hoped that the program would have a light- 
house effect in the school by encouraging other departments to 
investigate continuous progress. To that end the school requested 
some support funds specifically for developmental purposes by two 
departments a year. It was anticipated that the program would be 
self-sustaining after three years of support funding. Administra- 
tors were confident that Alberta Education requirements would be 
met. They welcomed student testing and program evaluation to 
prove program success. 

At the ProjecVs End 

In 1987, the open area of the Business Education Department at 
William Aberhart locked much as it did at the start of Project ABC 
with the addition of several computer terminals and a small locked 
enclosure to house the mini-frame computer, acquired by the 
department in 1985 under separate funding. However, although the 
open area could accommodate IO6 students at any one time, it was 
seldom full as the department had suffered declining enrolments 
since 198^. Although the school population held steady around 915 
students, a variety of factors worked against Business Education, 
including the following: 

1. Implementation of Provincial Grade 12 Diploma Examina- 
tions causing students to focus on core curriculum areas. 

2. The Alberta Secondary Review recommended increasec 
required credits leaving less opportunity for options. 

3. Growth of the school's Bilingual Program restricting a 
larger proportion of the students to fewer options. 

The decline in enrolment had a noticeab 9 impact on the open area 
as teacher coverage was also forced to decline. Instead of two or 
three teachers covering the area simultaneously, in 1^87 one or 
two teachers covered it and the possibility of closing the area 
completely for a period every day was becoming very real. 
Teachers were becoming less accessible to students as they were 
scheduled to teach some closed classroom courses, including a few 
in non-Business Education subjects elsewhere in the school. 



84 



- 61 - 



Project ABC funding had lasted fcr three years as anticipated, but 
once it ran out the school encountered some difficulty in locating 
funds to support the clerical aide who had become essential to the 
program. Some temporary relief was found but the future of that 
position became precarious. 

Teachers had received release time, particularly in the first year 
of the project, for curriculum revision and the preparation of 
unit packs but they were faced with a continually changing 
Business Education curriculum at the provincial level. By 1987, 
materials were out of date and teachers found little time to 
revise them with no support in this area. 

The Business Education program had acted as a lj[;htho. in that 
one other department in the school attempted to develop a similar 
model. From 1984 to 1986 the English Department became part of 
Project ABC at the request of its staff members, but no additional 
funds were allotted for its development. As planned, the Business 
Education budget was used to cover some costs. Ultimately, the 
program failed and the English teachers returned to their closed 
classrooms. Problem areas included the following: 

1 . Lack of seed money 

2. Lack of adequate planning 

3. Teacher-administrator communications 

4. Parental comaunication 

5. Organizational problems 

6. Student achievement 

The experiment had some positive outcomes, however, as the English 
teachers made the following gains: 

1. Professional development 

2. Varied teaching methods 

3. Aider use of materials 

4. Strengthened curriculum 

No other department took up the challenge. 
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Despite problems encountered by the Business Education Program, it 
remained at project end viable, mature, smoothly operating and 
successful, even if threatened with extinction due to low enrol- 
ments. 

Study Findings: Department-based Model 

Briefly, to review, the primary goal established for this evalua- 
tion study was as follows: 

To assess the success of the project schools in providing 
students with acceptable alternatives to the time credit 
relationships expressed in the cur ent Junior and Senior High 
School handbook where; 

(a) Ttie student achievement level is as good as or better 
than the achievement level in both local and provincial 
programs. 

(b) The Alberta Curriculum is adhered to. 

(c) Time has been removed as a requirement in awarding 
credit. 

(d) Competency has been made the basis for awarding credit. 

This section provides a summary of findings that relate specifi- 
cally to the Department-based Model at William Aberhart High 
School . 

(a) STUDENT ACHIEVEMENT 

In order to identify changes in achievement over time. 
Project students* final grades were analyzed in Typing 30, 
Accounting 30 and Law 30 from 1984 to 1987, using analysis of 
variance procedures. In Accounting 30, there was a 
significant decline in achievemant levels from 198^1 to 
1986. A summary of students* achievement levels for the 
Department-based Model is provided in Table 6. (Consult 
Appendix 1 for detailed analysis.) 
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TABLE 6 

STUDENT ACHIEVEMENT MEAN SCORES 
DEPARTMENT-BASED MODEL 
PROJECT ABC 

1984-1987 
1984 198j 1986 1987 

COURSE 

Mean Mean Mean Mean 

TYPING 30 63.2 56.7 62.8 -» 

ACCOUNTING 30 72.4 59.0 46.7 61.4 

LAW 30 60.0 73.5 65.3 70.2 



Student sample less than 5; therefore, analysis is not valid. 
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With regard to achievement level comparisons between project 
students and their peers within the system and within the 
province, project students* grades were compared with those 
of the control groups using analysis of variance procedures. 

Project students' grades in Typing 30 tended to be lower than 
those of control groups from 1984 to 1986 and were 
significantly lower in 1985. In 1987, the number of scudcr.ts 
involved was too small to analyze. In Accounting 30, 
students' scores tended to be lower than those of control 
groups from 1985 to 198V and u'cre significantly lower in 
1986. Law 30 mean scores tended to be higher than the mean 
scores of the control groups from 1985 to 1987 and wore 
significantly higher in 1985. A summary of significant 
differences in project students' mean scores is provided in 
Table 7. (Consult Appendix 1 for detailed analysis.) 

(b) CURRICULUM ADHERENCE 

Alberta Education consultants were asked to va' date the 
curriculum of project courses by determining the following 
two facts : 

1. If the content for each course matched the Program of Studies for 
Senior High Schools. 

2. If the standards applied in each course were comparable to those 
applied generally across the province. 

For each of the five years of the project, an Alberta Educa- 
tion consultant specializing in Business Education visited 
the program, spoke with staff members and reviewed instruc- 
tional materials, (Consult p. HH for a list of courses 
reviewed. ) The report prepared by the consultant was 
published annually in the Formative Evaluation Report. 
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TABLE 7 



SUMMARY OF SIGNIFICANT DIFFERENCES 
BETWEEN DEPARTMENT-BASED MODEL 
MEAN SCORES AND CONTROL GROUPS 
PROJECT ABC 

1984-1987 



COURSE 



YEAR 



MODEL CBE 
MEAN MEAN 



ALBERTA STATISTICAL 
MEAN COMPARISON 



TYPING 30 



1965 



56.7 66.0 



55 _g Significantly 
Lower* 



LAW 30 



1985 73.5 62.6 62.2 Significantly 

Higher* 



ACCOUNTING 30 



1986 16.7 68.7 



70.0 Significantly 
Lower* 



* Due to the small bamp'e size in the project model compared to 
the system and province populations, the analysis of variance 
may be distorted. 



8 9 



- 66 - 



The content of the Business Education courses was found to 
match the Program of Studies for the Senior High School in 
all but one case. In 1987, it was found that the Law 30 
course made provision for students to select eight out of a 
possible 11 modules of study, thereby allowing them to opt 
ou*: of certain sections of the material. All other courses 
throughout the project matched the prescribed curriculum. 

The standards for Business Education courses were also 
reviewed annually and, in all cases, were found to be 
comparable to standards applied generally across the 
province. 

To conclude, the curricula in Business Education courses 
offered to students at William Aberhart High School from 
I982-I987 did not vary significantly from provincial 
curriculum requirements in terms of either content or 
standards. No significant changes resulted in the Business 
Education curriculum when it was offered as an individualized 
program on a continuous progress basis* 

(c) TIME REMOVED AS A CREDIT REQUIREMENT 

Beginning in 1982, a student questionnaire with a Likert-type 
sc le was administered each semester to measure project 
students* attitudes and perceptions. Similar questionnaires 
were administered annually to project teachers and adminis- 
trators. Three items dealt specifically with the removal of 
time as a requirement in the granting of credit. The varia- 
bles and items were as follows: 

VARIABLE OUF.STIONNAIRE ITEM 

1. Stop Mechanism (Students) 

I can concentrate on a partjcula'* 
problem I am having until it is solved. 
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VARIABLE QUESTIONNAIRE ITEM 



1. 



Stop Mechanism 
(continued) 



(Teachers) 

Students can Interrupt their progress 
to concentrate on a particular problem 
they are encounter i ng unt : ' it is 
solved. 



(Administrators) 

Project ABC students can interrupt 
their progress to concentrate on a 
particular problem they are 
encountering until it is solved. 



2. Learning Rate Compa- (Students) 

tible with Ability I can spend as long as I need to 

complete course requirements. 

(Teachers) 

Students can take as much time as they 
need to comp I ete course requ i rements 
based on their learning needs. 



(Administrators) 

Project ABC students can take as much 
time as they need tc complete course 
requ i rements based on thei r learning 
needs. 



3. Flexible Entrance to (Students) 

Next Course Level I can begin the nexr course in th's 

subject whenever I am ready to do so. 



(Teachers) 

Students may enter the next course in 
this subject whenever they are ready to 
do so. 



(Administrators) 

Project ABC students may enter the next 
course i n a subject whenever they are 
ready to do so. 



In the formative evaluation, the CROSS-TABS p-ogram of SPSS 
was employed annually to identify significant differences in 
perception between project students and their local control 
group, and among students, teachers and administrators. 
Items which elicited significantly different perceptions then 
provided the basis for interview questions for a 107^ sample 
of students in the second semester. The results of these 
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interviews then provided the basis for further questions on 
the topics which were posed to teachers and administrators. 
In this v/ay, it was possible to clarify questionnaire results 
and probe for additional information. 

In the summative analysis , the three variables identified 
above were subjected to a univariate analysis of variance of 
student responses with year as a factor to determine change 
over time. The program employed was the SPSS Program ONEWAY 
with post hoc testing. This process helped to identify major 
changes in perception over time. Consult Appendix 1 for 
statistical findings related to the Department-based Model. 

Analysis of both statistical and interview data collected 
over the four-year period indicates that the Department-based 
Model was successful in providing students with a stop mecha- 
nism in their studies when encountering difficulty and 
allowed them flexibility in terms of when they could advance 
to the next course level. Perceptions were divided, however, 
as to whether students werp provided with the chance to vary 
their learning rate based on their ability. 

While teachers and administrators were positive in their 
questionnaire responses throughout the project that variable 
learning rates applied, students maintained that varied rates 
occurred only seldom or sometinies. However, over time, 
students ' comments in their interviews became more positive 
about varied learning rates. In 1984, 6H% (n=l4) said that 
they could not spend as long as they needed, to complete 
course requirements. By 1987, over 757^ (n=8) said that they 
could take as long as they needed, demonstrating that 
variable learning rates were perceived to be more in evidence 
by project end than they were initially. 

Figures gathered in 1987 indicated that out of 224 Business 
Education students taking courses in the open area during 
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that school year, 27. 27^ completed their courses early, 57.6fo 
took the full semester and 15.255 were granted extensions, 
thus indicating that flexibility with regard to learning rate 
was in effect. However, in their interviews, teachers 
reported consistently that or'\v students perceived to be good 
workers , good a'ctenders , or slow learners were allowed to 
continue .n a course for mere than one semester. This policy 
was not well communicated to students as they remained 
somewhat uncertain about course extensions at the end of the 
project. 

To conclude, time was removed as a requirement in awarding 
credit in the Department-based Model. Students had flexible 
use of time within the unit, opportunity for time extensions 
with teacher permission, opportunity to stop and 5olve a 
problem as it was encountered, and opportunity to commence 
the next level of a course as soon as they were ready. 
Students requiring more time than the norm were treated on an 
individual case basis. 



COMPETENCY THE BASIS FOR AWARDING CREDIT 



Variables and items on the questionnaires relevant to the 
topic of competency were as follows. 



VARIABLE 

1. Test Use at the Unit 
Level 



QUESTIONNAIRE ITEM 

(Students) 

1 write a test or do a special assign- 
ment at the end of each un i t in th I £ 
course. 



(Teachers) 

Students are tested for achievement by 
unit tests or special as'jignn?«nts a^ 
the end of each unit in my courses. 



(Administrators) 

Project ABC students are tesred for 
achievement at the end of eacn unit. 
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VARIABLE 



QUESTIONNAIRE ITEM 



Demons tra tec Competency 
at the Unit Level before 
Proceed * 



(Students) 

I must earn a certain mark In this unit 
test or special assignment before 
proceeding to the next unit. 



(Teachers) 

Students must demonstrate a specific 
level of competence for each unit of a 
course before proceeding to the next 
unit. 

(Administrators) 

Project ABC students must demonstrate a 
specific level of competence for each 
unit of a course before proceeding to 
the next unit. 



3. Advancement Based on (Students) 

Competency, Not Time I can exit from this course whenever I 

have completed the requirements. 



(Teachers) 

Students may exit from courses whenever 
they have completed the requirements. 

(Administrators) 

Project ABC students may exit from 
courses whenever they have completed 
course requirements. 



The data were treated in a similar way to that for Time 
Removed as a Credit Requirement, outlined above, for boch 
formative and summative evaluations. Consult Appendix 1 for 
statistical findings. 

Analysis of both statistical and interview data collected 
over the four-year period indicates that the Departinent-based 
Model was successful in testing students at the unit level 
and in ensuring that students demonstrated competency in 
their course material before progressing to the next course 
level. Opinions were divided, however, regarding whether or 
not students had to demonstrate competency at the unit level 
before progressing to the next unit. 
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While teachers and administrators were posir.ive in their 
questionnaire responses throughout the project regarding 
competency at the unit level, students' responses indicated 
that they felt this to be the case only sometimes. In 1984, 
79^ of students (n=1i|) said in their interviews that they did 
not have to get a certain mark on a unit test before pro- 
ceeding to the next unit. The following year, l\0% (n=10) 
said that they did have to earn a certain mark before pro- 
ceeding and responses did not change signif icar.^ :y in subse- 
quent years. Also in 1985, half of the teachers interviewed 
(n=6) indicatec* students had to obtain a passing grade before 
proceeding to the next unit and, again, responses did not 
change significantly over time. 

It appeared that there was a relationship between whether the 
nature of the course and whether competency "as lequired for 
each unit. Courses which were content-based, such as 
Accounting, tend'^d to have competency requirements while 
courses which were mainly non-sequential, such as Law, tended 
to allow students to redo unsuccessfully completed units at 
the end of the course. 

To conclude, competency was the basis for awarding credit in 
the Department-based Model in that tests were used at the 
unit level and advancement to the next course was based on 
competency demonstrated and not time spent; however, compe- 
t .y requirements at the unit level remained variable and 
appeared to depend on the nature of material in any specific 
course. There did not appear to be a department-wide policy 
on this topic. 

To summarize study findings specific to the Department-based Model 
as it developed in the Business Education Program at William 
Aberhart High School, Project ABC formalized a move which had been 
afoot for a number of years. Teachers had recognized the appro- 
priateness for an individualized, continuous progress model in a 
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simulated office setting. Facilities had already been renovatsd 
to this end and the timetable flexibility which i.ad resulted had 
attracted students to the program. 

Project ABC enabled teachers to prepare individualized materials, 
to allow students to progress at their own rate, to gain needed 
support in the areas of computer and clerical assistance and to 
benefit from staff development. 

However, by the end of the project, enrolments in Business Educa- 
tion courses had declined significantly due to the implementation 
of both provincial Departmental Exams and the recommendations of 
the Secondary Review, both placing greater demands for credits in 
core subject areas and leaving students with fewer opportunities 
to take option courses. In addition, the school's bilingual 
program had grown, further restricting the access of the student 
population to options. With the growth in the need for computer 
aid word processing courses, some of the population decline might 
have been offset with more aggressive program marketing. The drop 
in student enrolments also affected the open :irtia by decreasing 
teacher availability significantly as fewer teachers were assigned 
to the Business Education Department. As well with the termi- 
nation of .project funds, the clerical support position was 
cancelled, creating further non-instructional demands on teachers' 
time and cutting further teacher's individual time with students. 

Despite the setbacks, the study fi'^dings were generally encour- 
aging with regard to proj-ct goal attainment. Overall, students' 
achievement was comparable to that of non-project students within 
the Calgary Board of Eduiation and the Province of Alberta as few 
significant differencos were identified, although final grades in 
Typing 30 and Accounting 30 tended to be somewhat lower. The 
curriculum offered in the individualized format did not vary 
significantly from provincial requirements in terms of either 
content or standard?. Time was removed as a requirement in award- 
ing credit as students had flexible use o. time within the unit. 
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opportunity for extensions with teacher permission, opportunity to 
stop and solve a problem as it was encountered and opportunity to 
begin the next level of a course as soon as they were ready. 
Individual students with extension needs were treated on a case by 
case basis. Competency was made the basis for awarding credit in 
general terms. Tests were used at the unit level and advancement 
to the next course was based on competency demonstiated rather 
than time spent in the course; however, competency at the unit 
level remained variable mainly due to the non-sequential nature of 
units in many Business Education courses. It appeared that no 
departmental policy had been developed regarding competency at the 
unit level, 

William Aberhart High School had demonstrated by the end of 
Project ABC that an individualized, continuous progress program 
could function smoothly in an option area and that project 
concepts were particularly appropriate in Business Education 
because it fostered a real business environment. Events beyond 
the control of the program had reduced enrolments significantly, 
however, and the future of the program was uncertain. 
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Parallel Core Program Model 
Before the Project 

John G. Diefenbaker High School opened in 1970 with a unique 
physical plant. ^ It had a number of large open area instructional 
spaces, as well as flexible classrooms, regular classrooms and 
seminar rooms. The library was placed adjacent to the Humanities 
area to encourage the integration of research into the program. 
All science labs were located in one area and could accommodate 
three to four classes at a time. The Math Department had an open 
instructional area in addition to several classrooms. Mon-core 
subjects were taught in traditional classroom space. The school 
was unsemestered in Grades 10 and 11 and semestered for Math and 
the Sciences in Grade 12. 
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The school's curricula included a number of unique features. The 
Humanities program was a team-taught integration of Social Studies 
and English and had been in place for ten years. It had made a 
great deal of use of alternative methods of instruction. An 
individualized, self -paced Math program for selected students had 
been in place for four years and included a computerized test bank 
entitled Q-Math. Locally developed Science options were taught in 
the school, involving many elements of individual choice- The 
Biology and Chemistry courses also incorporated individualized 
activities into their programs. 

Another feature was the use of personalized report letters. Staff 
members were used to reporting for self-pacing and continuous 
progress. Further, many Grade 12 students were accountable for 
their own attendance and independence was fostered. Finally, a 
test centre had been operating for three years, staffed by parent 
volunteers, to accommodate the many self-paced components of the 
school's curriculum. 

In 1981, Diefenoaker had an enrolment of 1105 students (including 
319 students in Grade 9) and a teaching staff of 59. The proposal 
for involvement in Project ABC of PEP (Personalized Education 
Program) focussed on the concept of developing "a school within a 
school""* for students identified as being independent, persistent, 
motivated and responsible. These students were seen as ideal 
candidates to learn a prescribed curriculum through flexible time 
use and increased choice. The program would begin in 1982 with 
90 - 100 Grade 10 students in the alternative program and would 
expand in each of the next two years to Grades 11 and 12. It was 
estimated that by 1984 over half of the high school would be 
enrolled in this program. Eligibility would be determined by a 
variety of learning styles tests and parental permission. The 
program was not to be identified as elitist in any way but would 
be for both academic and non-academic students who learned inde- 
pendently. 
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Other program characteristics would include: 

1. A combination of flextime and demand time for each of the 
core curriculum areas (Humanities , Mathematics and 
Science) . 

2. Regular classroom instruction for options. 

3. Program teachers on a full-time flexible assignment. 

4. Each student to be assigned to a Teacher Advisor who 
would monitor progress on a regular basis. ^ 

5. Physical Education already modularized would be available 
at times of choice. 

In 1983, as the program expanded to Grade 11, more teachers would 
be involved and students would experience more flextime as they 
had fewer options. By 1984 with the full program in place, Grade 
12 students would be on total flextime for core courses and conti* 
nuous progress would accelerate.^ It was never the intention of 
the program that a main objective be early completion^ but as the 
proposal stated, differing dates of completion would expand as the 
program enlargefi.^ Curricular objectives and tests would be the 
same for both the alternative and the regular programs. The 
assumption was made that students would achieve at a higher rate 
if learning styles were taken into account and if selection proce- 
dures were accurate.^ In fact, teachers and administrators went 
on record to state that they believed the following: 

♦ Students mature and gain self-confidence in their approach 
to learning when they take responsibility for that learn- 
ing. 

♦ Students take education seriously when they play an active 
part in its design; it gives them ownership. 

♦ Students accomplish more learning v;hen they are comfortable 
with a learning style that meets their unique needs. 

♦ Student learning can be enriched by peer interaction and 
more individualized student-teacher interaction. 

♦ Students are better able to define their personal capabili- 
ties and limitations if they can make choices of how, with 
whom, how much time, when and where they will learn speci- 
fied curriculum.'^ 
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The administration at Diefenbaker saw Project ABC as a chance 
to provide an alternative program for independent learners. 
Funds were requested for in-service training, computer 
upgrading, release time for curriculum preparation, an addi- 
tional teacher for the first year, a lab technician and a 
Math technician-clerical aide starting in the second year to 
assist with testing and record keeping. Beyond the third 
year, it was felt that regular funds would suffice apart from 
the maintenance of the two paraprofessionals. It was recom- 
mended that administration have more involvement in staff 
selection than had been the case to ensure teacher interest 
in and commitment to the program. Again, provincial testing 
and program evaluation were welcomed. 

At the ProjecVs End 

In 1987, PEP enrolment reached 350 or 3^% of Diefenbaker 's 1030 
students (now excluding Grade 9) and the teaching staff totalled 
53, 12 of whom taught exclusively or nearly exclusively in PEP. 
In addition, PEP had zwo full time aides, the lab technician and 
the math aide. All core subjects were provided to PEP students in 
each of the three grade levels in an alternative learning mode. 
There was, however, no evidence of Physical Education being 
available at times of choice. 

The use of learning package.'^ was incorporated into the program 
along with large and small group activities and independent 
projects. Learning styles were addressed by initial selection and 
by providing students with alternative assignments and approaches. 
Students planned their weekly schedule in advance, submitting it 
to their Teacher Advisor for approval, arranging all their core 
subject time into fiextime or demand time depending on their 
learning needs that week and on possible demand classes to attend. 
Typically, teachers ran a demand class three or four times during 
a week and students sigred up for the one of their choice. Within 
the span of a unit, students could determine when to write their 
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unit test and die so at the test centre. All tests used in PEP 
were the same as those in the regular program and standards were 
comparable although, as time went by, it appeared that teacher 
expectations for PEP students increased. 

On any one school day, PEP students could be observed scattered 
through the three open areas as well as through classrooms, 
conference rooms ard the library in a variety of configurations: 
independent study, peer work groups, small group projects, demand 
classes of varying lengths and large group activities. Enrichment 
was stressed in the program as students were encouragea to stretch 
their capabilities. The Teacher Advisor system had expanded 
throughout the school and the Test Centre was being increasingly 
utilized by the regular program as well as by PEP. The PEP 
students tended to be confident, assertive and organized and 
seemed drawn to leadership positions in the school. Consistently 
throughout the study, PEP students expressed i>ignif icantly greater 
satisfaction than regular students with affective components of 
the program such as satisfaction with program organization and 
challenge, teacher interest in students and communication both 
between students and teachers and between students and their 
peers. While the program continued to address the needs of all 
independent learners, there was growth in the emphasis on 
challenge activities, thinking skills and creative problem 
solving. Staff commitment was high throu-'iout the project and 
monthly or bimonthly PEP meetings off campu continued to play an 
important role in both democratic decision making and professional 
development. 



While the program was considered highly successful by partici- 
pants , parents and administrators, in terms of Projecc ABC its 
success remained qualified, due to the movement of the program 
away from the concept of continuous progress. The staff came to 
believe that the established affective goals at the school were 
incompatible with a continuous progress model in which students 
are encouraged to work at individual rates. A primary objective 
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of the school was to stress the conununications skills: speaking, 
writing, reading, listening, viewing, debate and information 
retrieval. Another objective was to develop a process or lab- 
centred approach to Science. The degree of pupil-teacher inter- 
action and peer interaction required to successfully meet those 
objectives was seen to be incompatible with a continuous progress 
model. 

Study Findings: Parallel Core Program Model 

This section provides a summary of study findings related to the 
primary goal established for this evaluation, as outlined 
previously, and refers specifically to student achievement, 
curriculum adherence, time removed as a credit requirement and 
competency becoming the basis for awarding credit. 

(a) STUDENT ACHIEVEMENT 

In order to identify changes in achievement over time, 
project students' final grades were analyzed in a number of 
30-level courses from 1985 to 1987 using analysis of variance 
procedures. In all cases, the blended grades were used 
(i.e., combined Grade 12 Diploma Examination grade and 
teacher-assigned grade.) 

Overall, students* achievement levels fluctuated very little. 
Mean scores tended to increase ovei time in English 30 and 
tended to decrease in Math 33. The only significant change 
was in Chemistry 30 where students* mean scores rose signifi- 
cantly from 1986 to 1987. A summary of students' achievement 
levels for the Parallel Core Program Model is provided in 
Table 8. (Consult Appendix 2 for detailed analysis.) 
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TABLE 8 

STUDENT ACHIEVEMENT MEAN SCORES 
PARALLEL CORE PROGRAM MODEL 
PROJECT ABC 

1985-1987 



COURSE 


1985 


1986 


1987 




Mean 


Mean 


Mean 


ENGLISH 30 


65.7 


66.2 


68.3 


ENGLISH 33 


63.2 


61. 1 


61.0 


SOCIAL STUDIES 30 


66.7 


70.3 


67.1 


MATH 30 


66.3 


65.9 


70.8 


MATH 33 


66.1 


59.7 


58.0 


BIOLOGY 30 


66.6 


68.0 


66.3 


CHEMISTRY 30 


70.8 


63.7 


71.1 


PHYSICS 30 


70.5 


71.2 


69.0 
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With regard to achievement level comparisons between project 
students and their peers within the system and within the 
province, project students' grades were compared with those 
of the control group using analysis of variance procedures. 

Generally, project students' grades tended to be higher than 
those of their peers both in the system and in the province 
from 1985 to 1987, although only one course in one year was 
significantly higher. Achievement levels in Chemistry 30 
were significantly higher than those of control groups in 
1987. (Consult Table 9 for a summary of findings and 
Appendix 2 for a detailed analysis.) 

CURRICULUM ADHERENCE 

Alberta Education consultants were asked to validate the 
curriculum of project courses by determining the following 
two facts: 

K If the content of each course matched the Program of Studies for 
Senior H;gh Schools. 

2. If the standards applied in each course were comparable to those 
applied generally across the province. 

For each of the five years of the project, Alberta Education 
consultants specializing in each of the four core areas of 
English, Social Studies, Mathematics and Science were asked 
to visit the program, speak with staff members and review 
instructional materials. (Consult p. for a list of 

courses reviewed.) The reports prepared by consultants were 
published annually in the Formative Evaluation Report. 

The content of all courses offered in PEP was found to match 
the Program of Studies for Senior High Schools andj in fact, 
the Science and Humanities programs were found to exceed the 
Program of Studies requirements in 1986. 
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TABLE 9 

SUMMARY OF SIGNIFICANT DIFFERENCES 
BETWEEN PARALLEL CORE PROGRAM 
MEAN SCORES AND CONTROL GROUPS 
PROJECT ABC 

1985-1987 



COURSE YEAR ^^^^^ ALBERTA STATISTICAL 

MEAN MEAN MEAN COMPARISON 



CHEMISTRY 30 198? 7^1.1 68.1 68.0 Significantly 

Higher 
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The standards of all courses in the program were found to be 
comparable to those applied generally across the province for 
all five years of the project. 

To conclude, the curriculum offered to PEP students at John 
G. Diefenbaker High School from 1982 met or exceeded provin- 
cial curricular requirements in terms of content and met 
provincial standards in al] casej. The consultants consis- 
tently submitted very positive reports about the PEP curri- 
cula and commended teachers for their commitment to the 
program. 

TIME REMOVED AS A CREDIT REQUIREMENT 

Data regarding student, teacher and administrator perceptions 
about the removal of time as a requirement in the granting of 
credit were treated in the same way as for the Department- 
based Model. Consult Appendix 2 for statistical findings. 

Analysis of both statistical and interview data collected 
over the four-year period indicates that the Parallel Core 
Program Model was successful in providing students with a 
stop mechanism in their studies when they were encountering 
difficulty. Flexible entrance to the next course level was 
not available to students because the program did not provide 
for continuous progress. Learning rate variability was 
addressed in a way which was unique to this program and is 
outlined below. 

Students, teachers and administrators agreed that students 
could not take as much time as they needed to complete course 
requirements. The program was designed in such a way that 
all students began each unit together so time was limited to 
the traditional dictates of the curriculum in overall terms. 
However, a closer lock revealed that time use appeared to be 
variable within the parameters of any particular unit. In 
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1985, data were collected regarding students* time on task 
within the unit. The evidence was conclusive that students' 
time was variable within the unit and was to a large extent 
determined by students' own perceptions of their learning 
needs. Thus, it was unlikely that any student would spend 
exactly 125 hours on a particular course over the span of a 
school year. In this way the Carnegie Unit was broken. 



However, the parameters of variability were limited by poten- 
tially conflicting demands from a student's other core and 
option courses, Wich a set number of flexible hours in a 
school week, a student could only apportion part of that time 
to the needs of any particular course. Program administra- 
tors indicated in their interviews that the limitations were 
negligible due to both initial student selection procedures 
and a three-tiered policy developed to handle learning rate 
variability. This policy was as follows: 

1. Remedial Loop - A student could continue for up to two 
units' worth of work without demonstrating competence so 
long as he was involved concurrently in remedial activi- 
ties to bring him up to a satisfactory level of compe- 
tency within that period. 

2. Stream change - After being unable to catch up or dem- 
onstrate success during that two unit period, the student 
was transferred to a less difficult course (e,g, from 
Math 10 to Math 13), 

3. Program change - If course change alone did not help to 
solve the student's difficulties in demonstrating compe- 
tence, he was counselled out of PEP to the more struc- 
tured regular program,'^ 



In this manner, students encountering difficu] in the 
program could be counselled out of it. Coupled with program 
entrance criteria as well as a certain amount of self- 
selection which likely occurred once the program became well 
known, this policy helped to ensure student success in the 
program and decreased the need for variable learning rates. 
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To conclude, the Parallel Core Program Model removed time as 
a requirement in awarding credit to the extent that students 
were provided with an opportunity to stop and solve a problem 
as it was encountered and to vary time use within the unit 
according to their learning needs. However, students were 
not able to begin the next level of a coarse early or obtain 
an extension beyond the end of the ^i^ernester or year because 
the concept of continuous progress was not adopted in this 
model, 

(d) COMPETENCY THE BASIS FOR AWARDING CREDIT 

Data regarding student perceptions about competency becoming 
the basis for awarding credit were treated in the same way as 
for the Department-based Model, Consult Appendix 2 for 
statistical findings. 

Analysis of both statistical and interview data collected 
over the four-year period indicates that the Parallel Core 
Program Model was successful in testing students at the unit 
level. Individual advancement based on competenry demonstra- 
ted at both the unit and course levels was not perceived to 
be available by either students or teachers although adminis- 
trators tended to disagree about demonstrated competence at 
the unit level. 

While continuous progress remained a suggested option in the 
school's program literature, teachers and administrators 
replaced opportunities for continuous progress with enrich- 
ment and challenge. Therefore, they did not encourage early 
completion and provided the three-tiered policy to address 
the needs of students encountering difficulty. In their 
interviews, students remained uncertain about whether or not 
they could progress at individual rates and teachers tended 
not to discuss this option with students. 
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Competency issues were dealt with in a variety of ways other 
than individual continuous progress. In the first place, the 
great flexibility afforded students at the unit level 
provided many opportunities for one-on-one interaction 
between students and teachers. Secondly, competency was 
supported by initial student selection procedures, whether 
through required entrance criteria or, in cases where 
requirements were waived due to high motivation levels, 
through self-selection. Thirdly, curricular ma*-.erials 
addressed a variety of learning styles, which coupled with 
frequent testing and feedback, promoted student success. In 
fact, failure levels remained low throughout the project 
indicating that while individual advancement was regulated, 
individual competency was thoroughly addressed. 

To conclude, competency was the basis for awarding credit in 
the Parallel Core Program Model, but individual advancement 
in either unit or course was not possible. 

The requirement that students demonstrate competency before 
proceeding to the next unit remained at unsatisfactory levels 
throughout the project and, in fact, declined over time 
although no significant v g^s occurred. 

In 1984, competency was not the criterion for advancement to 
the next unit as students proceeded from unit to unit 
together. The three-Mered policy referred to above crystal- 
lized in 1985 to handle students* lack of demonstratea compe- 
tence at the unit level; however, by I986 the remedial loop 
component o^ this policy had become a minor consideration 
which may have been due to the student selection process 
occurring simultaneously (also referred to above). In other 
words, students requiring extensive remediation may no longer 
have been in the program . Both students ' and teachers ' 
perceptions of the use of demonstrated competency before 
proceeding to the next unit had declined from initial levels by 
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The criterion of advancement based on competency declined 
significantly during the course of the project. The variable 
was very significant with an F (3, 495) = 26.71, p = <.001. 
The Scheffe procedure indicated significant differences 
between 1984 and 1985, 1984 and 1986, and 1984 and 1987. 
There was a significant decrease in the mean in every other 
year compared to 1984. This pattern is similar to that found 
for the criteria related to time removal as a credit require- 
ment, namely learning rate compatibility with ability and flexible 
entrance to the next course level. The similarity of findings 
regarding these closely linked concepts provides support for 
the validity of statistical approaches employed. 

To summarize study findings specific to the Parallel Core Program 
Model as it developed in PSP at John G. Diefenbaker High School, 
Project ABC allowed the school to pursue its goals of student 
independence and responsibility through the development of an 
alternative learning model for selected students. The school *s 
physical plant and a variety of unique features in the curriculum 
fostered alternative instructional methods and teachers had 
already experimented with individualization and self-pacing. 

By the end of the project, PEP had emerged as a strong and clear 
alternative to the regular program providing a core program for 
students in Grades 10 through 12 who were identified as independ- 
ent learners. The program endorsed student choice in terms of 
time use within the unit and was supported by a Teacher-Advisor 
system and a Test Centre. Student satisfaction was consistently 
and significantly higher than that of students in the regular 
program. Achievement of project students tended to be comparable 
or somewhat higher than achievement levels in the system and the 
province and one course. Chemistry 30, was significantly higher 
than control groups in the final year of the project. 

The curricula offered in PEP met or exceeded provincial require- 
ments in terms of content and standards were comparable with those 
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employed across the province. Consultants from Alberta Education 
were consistently positive in their comments about the curricula 
developed in the project for PEP. 

As PEP developed, however, it became apparent that the program had 
charted a somewhat different course for itself than the one 
initially proposed. By project end PEP was clearly an alternative 
program which espoused the concept of variable time use within the 
unit but not within the school year. It had minimized the need 
for competency-based advancement by the selection of appropriate 
students who could succeed within the time limits provided, by the 
provision of materials for a variety of learning styles and by 
allowing for extensive one-on-one interaction between students and 
teachers. Further, program growth was evident in the area of 
student challenge as the curriculum began to move beyond pres- 
cribed materials into enrichment areas. It did not, however, 
provide a continuous progress alternative for students, for while 
breaking the traditional Carnegie Unit, it did not allow indivi- 
dual students to progress at their own rate. PEP had become an 
excellent program for independent learners but in clarifying its 
own goals, had eliminated continuous progress. 



School-wide Model 
Before the Project 

In 1981, Ernest Manning High School was a traditional comprehen- 
sive, fully-semestered high school with 7^15 students and Hi .5 
teaching staff. The school had recently developed a philosophy 
which was student-centered in intent. The school administration 
and staff were looking for an innovative project to help foster 
the following two goaJs: 

1. That students could develop a positive self-image. 

2, That students would develop a continuing interest In 
learning and pride in accomplishments.'" 
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They felt that the Carnegie Unit restricted their student-centered 
focus by discouraging both high and low ability students and by 
stressing only the cognitive area. Their Business Education 
Department had already developed a form of continuous progress 
through the use of individualized and small group instruction, 
learning units and timetable flexibility. 

The school's ultimate goal, as identified by their proposal was to 
make the school "sensitive to and capable of recognizing a number 
of different delivery systems for different perceived needs of 
students, Each department was to develop programs to meet "one 
or more"^^ of the following outcomes: 

1, Selection of appropriate learning styles, 

2, Student movement through courses at their own rate, 

3- Flexibility in course scheduling to increase availability 
to students, 

4, Better programs of remediation and enrichment. 

It was felt that, "while moving in a broken front, "'^ this goal 
could be reached in three to five years. Three stages of develop- 
ment would occur. In the first, due to the varying states of 
readiness exhibited by staff members, extensive staff development 
would be required, including workshops and visits to other similar 
programs in North America, Carriculum development would occur in 
Business Education, Mathematics and, to a limited extent, in 
Social Studies, In the second stage, all departments would 
prepare the program they intended to implement and school policies 
would be modified. In the third stage, the departments would 
implement their programs, evaluate their results, and make appro- 
priate changes. The proposal was unable to predict what possible 
directions the program might take in order to personalize educa- 
tion,^^ but it was expected that learning styles would be accommo- 
dated in such a way that the following would occur; 

1, Some students would be in traditional classrooms, 

2, Some students would be highly independent moving at their 
own rates, 

3- Some students would be in a combination of the above. 
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Eventually all students wCMld be affected in the move toward 
continuous and individual progress. It was anticipated that 
teacher relief time would be required as would clerical help and 
computer upgrading to support material production and student 
tracking. Administrators were corTident that the Program of 
Studies for Senior High Schools would be adhered to and they 
welcomed hesting and evaluation. 



At the Projects End 



In 1987, enrolment at Manning reached 780 students due to the 
closure of a high school nearby and had a teaching staff of 43.5. 
Project ABC, or PACE (Personalized and Continuous Education), had 
grown to encompass the whole school, but it was the first year 
that Grade 12 was functioning as part of the project. Development 
tended to be slower than anticipated due to the size of the task 
at hand, the time needed to realign staff philosophy and the lack 
of either clear school-wide or procedural goals during the early 
years. 



However, despite delays, a vision statement for the program was 
hammered out in 1986, as follows: 

The PACE Program at Ernest Manning High School reflects the 
school *s philosophy which endeavours to ensure individual 
student development through effective education. The program 
provides an environment which focusses on the learner in 
order to match the method of learning with the material to be 
learned. Students are able to progress at a rate at which 
they are capable, after having to demonstrate competence at 
each level of their courses. Students will be given educa- 
tional opportunities and choices which are designed to assist 
them in becoming more self-directed and responsible for their 
learning. 



The following program goals were identified: 

1. To create a more personalized and humanistic environment. 

2. To provide more direct assistance in educational planning 
and goal setting through the active participation of 
students, teachers, parents and Teacher Advisors. 
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3. To facilitate differing rates of student progress by 
providing multiple exit and entry points. 

4. To focus on demonstrated competence as the criterion for 
advancing to the next unit or course 

5. To provide students with a range of alternatives within 
the curriculum involving 

• what will be learned 

• how it will be learned 

• where learning will occur 

• when learning will occur 

• who will assist the learning. 

6. To provide an educational environment based upon the 
needs of individual students. 

7. To develop student self-direction and responsibility by 
having the student actively participate in the planning 
and evaluation of his/her educational program. 



In addition, major elements of the program were outlined including 
the following: 

1. The provision for students to learn at different rates 
(including policies for early and late completion of 
courses) . 

2. The provision for students to learn in different ways 
(including different learning styles and environments). 

3. Advancement based on competency (including remedial or 
enrichment opportunities). 



The role of the student, teacher and Teacher Advisor in relation 
to the program was clearly outlined as was a commitment to parents 
about their involvement. 



While initial development had a department focus, the model became 
truly school-wide as the need evolved for coordination. A number 
of administrative policies also grew out of this need as follows: 

1. Competency level for courses placed at 50% but variable 
at the unit level according to the demands of the 
material. 
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2. Six course entry and exit points which coincide with the 
six reporting periods during the year. 

3. A six~week extension to a course (i.e., one reporting 
period) could be negotiated by students depending on 
commitment, attendance and time on task. Further time 
could be obtained after extensive consultation. 

4. A progress check made for each student in every course 
every three weeks. 

5. An attendance policy which could culminate with a 
student's withdrawal from a course after 10 absences. 

Other support systems which evolved included an extensive Teacher 
Advisor system, a large test centre, and computerized record 
keeping and student tracking systems. 

Generally speaking, from extended observation in the school over a 
five-year period, it can be concluded that no classrooms could be 
considered traditional any longer. Until I985, an attempt was 
made to run a two-track school (i.e., traditional and individu- 
alized) but as the definition of PACE broadened and became 
clearer, that concept faded. Instead, students were considered 
"on PACE" and their instructional needs in each subject were met 
in the most appropriate way. Thus, in most classrooms, in any one 
period, a variety of instructional methods could be observed 
including lecture, small group discussion and independent work. 
The curricula in all three grades were extensively rewritten into 
learning guides although many units still required further revi- 
sion, particularly at the higher levels. Also, due to the broken 
front approach in the project's developmental phase, some depart- 
ments had stronger materials than others and format varied widely. 

The clerical aide acquired for the project managed the test centre 
with its parent volunteers and coordinated material production and 
duplication. By the end of the project, she had a full-time 
assistant, funded separately through assistance from the federal 
PEP program, to help handle the volume of tests. In a five-month 
period in the I986-I987 school year nearly 9,000 tests were 
administered and processed. 
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When in place, the impact of the Manning project was far more vast 
than could have been foreseen and the degree of change required to 
make it work was more taxing on personnel than anyone had envi- 
sioned. While fully functioning by project end, the program had 
not had the time to mature and stabilize which would have been 
desirable. However, results were encouraging. 

Study Findings: School-wide Model 

This section provides a summary of study findings related to the 
primary goal established for this evaluation, as outlined pre- 
viously, and refers specifically to student achievement, curricu- 
lum adherence, tLne removed as a credit requirement and competency 
becoming the basis for awarding credit. 

(a) STUDENT ACHIEVEMENT 

In order to identify changes in achievement over time, 
project students* final grades were analyzed in Math 30, Math 
33 and Typing 30 in 1986 and 1987, using analysis of variance 
procedures. 

Student achievement increased significantly in Math 30 from 
1986 to 1987. A summary of students' achievement levels for 
the School-wide Model is provided in Table 10. (Consult 
Appendix 3 for detailed analysis.) 

With regard to achievement level comparisons between project 
students and their peers within the system and within the 
province, project students* grades were compared with those 
of the control groups using analysis of variance procedures. 
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TABLE 10 

STUDENT ACHIEVEMENT MEAN SCORES 
SCHOOL-WIDE MODEL 
PROJECT ABC 

1986-1987 



1986 



1987 



COURSE 



Mean 



Mean 



MATH 30 



60.6 



73.3 



MATH 33 



56.3 



55.4 



TYPING 30 



65.9 



70.7 
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projects students' grades in Math 30 were significantly 
highei' than chose of control groups in 1987. Students' 
grades in English 30 were significantly lower than those of 
control groups in the same year. With only one year of 
statistics available for analysis at the 30-level by the end 
of the study, it is not possible to draw any conclusions 
about student achievenient in the model . A summary of 
significant differc.ices in project students* mean scores is 
provided in Tabie 11. (Consult Appendix 3 for detailed 
analysis) 

CURRICULUM aDHERENCE 

Alberta Education consultants were asked to validate the 
curriculum of project courses by determining the following 
two facts: 

1. If the contents of each course matched the Program of Studies for 
Senior High Schools. 

2. If rhe standards applied in each course were comparable to those 
applied generally across the province. 

During the first year of the project, no curriculum was 
evaluated as the program's focus was on staff development, 
but for the final four years of the project, Alberta 
Education consultants visited both core and option courses, 
spoke with staff members and reviev-jed instructional 
materials. (Consult p. 44 for a list of courses reviewed.) 
The reports prepared by consultants were published annually 
in the Formative Evaluation Report. 

The content of all courses in the program were fc ^nd to match 
the Program of Studies for Senior Hi<3h Schools and some units 
in English were judged to be exemplary. Many units in most 
subjects, however, were still evolving by project end. 
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TABLE 11 

SUMMARY OF SIGNIFICANT DIFFERENCES 
BETWEEN SCHOOL-WIDE MODEL 
MEAN SCORES AND CONTROL GROUPS 
PROJECT ABC 



1987 



COURSE 


YEAR 


MODEL 


CBE 


ALBERTA 


STATISTICAL 




MEAN 


MEAN 


MEAN 


COMPARISON 


MATH 30 


1987 


73.3 


67.7 


68.3 


Significantly 












Higher 


ENGLISH 30 


1987 


60.8 


61!. 9 


65.0 


Significantly 










Lower 
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The standards of all courses in the program were found to be 
comparable to those applied generally across the province 
throughout the project. In 1986, it was found that evalua- 
tion criteria were not always clearly outlined for students, 
again underlining the developmental stage of curricular 
materials. By the end of the project, most courses were able 
to provide multiple versions of unit tests for the ttjt 
centre. 

It must be noted that only in the School-wide Model were the 
principles of individualization and continuous progress 
applied to a broad spectrum of option courses such as Build- 
ing Construction, Food Studies, Art and Physical Education, 
In all cases, teachers appeared to welcome these principles 
as appropriate for instructional delivery. Areas where 
individualization and continuous progress were somewhat 
limited included Music and Drama where group needs were 
determined to be overriding. 

(c) TIME REMOVED AS A CREDIT REQUIREMENT 

Data regarding student perceptions about the removal of time 
as a require.Tient in the granting of credit were treated in 
the same manner as that for the two programs described 
earlier. Consult Appendix 3 for statistical findings. 

Of particular interest for the purpose of analysis in the 
School-wide Model, are data collected for the latter three 
years of the project because it was during this period that 
PACE was implemented on a grade-by-grade basis. 

Analysis of statistical and interview data collected during 
these three years indicates that the School-wide Model 
successfully provided students with a stop mechanism in their 
studies when they encountered difficulty. While flexibility 
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regarding learning rate variability and varied course 
entrance times was cer^inly in evidence, perceptions 
regarding the degree of flexibility differed. 

Teachers and administrators perceived that the PACE program 
made provision for varied learning rates according to 
students ' capabilities while student perceptions declined 
significantly in 1987 from their view in I986, -'ndicating 
that varied learning rates were available only seldom or 
sometimes. Interview data supported this changing percep- 
tion: in 1986, 80^ of students interviewed (n=66) said they 
could get extra time to complete their course if needed; in 
1987, 38^ (n=54) agreed, although over one-half of the group 
admitted having received extra time in at least one course in 
the past. In fact, the granting of extensions did decline in 
1987 when 7.9*^ of registered students (n=l830) received 
course extensions as compared to 27.9/5 (n=8l6) in 1986, 
(Consult Table 12.) 

The decline in student perceptions in I987 regarding learning 
rate variability likely reflected the administrative policies 
related to time which were implemented in the last two years 
of the project. Administrators believed in particular that 
the six-week extension policy cut down on abuse of students' 
new freedom by encouraging them to focus on the task at 
hand. However, two-thirds of the teachers interviewed in 
1987 (n=5) felt that students did not understand the implica- 
tions of the six-week entension policy and their own inter- 
pretation of '^^udent perceptions varied. Overall, it 
appeared that new expectations had not been completely 
assimilated. 
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TABLE 12 

STUDEJJT TRACKING SUMMARY 
SCH{X)L-WIDE MODEL 
PROJECT ABC 

1986-1987 



NUMBER OF 



NUMBER OF S S X 

YEAR courSeV student-course COMPLETED TOOK GRANTED 

REGISTRANTS EARLY SEMESTER E>aENSION 



1986 22 816 14.7? 57.4? 27.9? 

1987 26 1830 15.9? 76.2? 7.9? 



122 



- 99 - 



The impact of new policies related to time was also evident 
in the significant decline in student perceptions regarding 
flexible entrance to the next level of a course, again a 
percept- ion not shared by teachers or administrators. In 
fact, flexibility was evident in that of 1830 student-course 
registrants sampled in I987, ]5.H% completed their courses 
early, compared with 1^1.77^ the previous year (n=8l6). Early 
course completers had increased by project end while those 
granted extensions had decreased. 

To conclude, time was removed as a requirement in awarding 
credit in the School-wide Model. Students were provided with 
a stop mechanism to deal with difficulty as it was encoun- 
tered, they were able to complete a course early and to 
advance to the next course level at six-week intervals, and 
they could take more time than a semester if it was necessary 
but had to demonstrate commitment, attendance and time on 
task. Tightened administrative policies related to time use 
had negatively influenced student perceptions in 1987 but 
this view was not shared by teachers or administrators. It 
was impossible to predict if the decline in student percep- 
tions was temporary; statistical findings remained volatile 
until project end. Additional time to allow this program to 
mature would have helped to clarify study findings further. 
However, it was evident that time use was flexible in this 
program and that the 125 hour standard had been broken. 

(d) COMPETENCY THE BASIS FOR AWARDING CREDIT 

Data regarding student perceptions about competency becoming 
the basis for awarding credit were treated in the same way as 
for the previous two models. Consult Appendix 3 for statis- 
tical findings. 
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Analysis of both statistical and interview data collected 
during the study indicates that the School-wide Model was 
successful in making competency the basis for awarding 
credit* 

The use of tests at the unit level was satisfactory in 
project terms throughout the project. The test center 
expanded each year as another grade came on stream and as 
teachers developed multiple versions of each test. By the 
end of the project, there were more than 1000 unit tests on 
file. The centre was coordinated by a full time parapro- 
fessional who was assisted by parent volunteers and a grant- 
funded support person. On an average day, about 100 students 
wrote tests there. 

Competency was the criterion by which students were judged 
and allowed to proceed, either to the next unit or the next 
course level. Overall, 79.6% of students interviewed (n=54) 
indicated that they could leave a course as soon as they had 
completed the requirements. They either took a spare period, 
worked in other courses or began a new course. Teacher .and 
administrator interview data identified variations between 
subject areas. In particular, it was indicated that English 
and Social Studies, with their requirements for seminars and 
group discussion, were less likely to have many students 
completing early, although some evidence of this did 
exist. Further, administrators also perceived variation as 
being related to differences in the personalities of staff 
members. This observation is supported by findings in the 
policy Delphi Study that certain teacher characteristics are 
particularly appropriate for this type of program. 2' 

To conclude, based on student, teacher and administrator 
perceptions, as well as observation, competency became the 
basis for awarding credit in the School-wide Model and thus 
this critical project goal was achieved by this school. 



124 



- 101 - 



To summarize study findings specific to the School-wide Model as 
it developed at Ernest Manning High School, Project ABC provided a 
traditional comprehensive high school with a unique opportunity to 
personalize learning by addressing learning styles and providing 
for variable learning rates. The school embarked on a complex and 
far-reaching project with little more than a philosophical stance 
shared by some key staff members. 

Five years later, major changes had happened to staff and students 
in the way they interacted and to administration in the way it 
regulated student movement through courses. A Teacher Advisor 
system had helped to focus student trac. ing and had improved 
communication throughout the school and between the school and the 
home. Students and teachers had adapted to the concept of six 
entry and exit points in the school year so that student advance- 
ment to other courses was visible every six weeks rather than at 
semester end. A glance at any class list revealed the variety of 
grades represented by students attending any one particular 
course. Teaching methods had broadened considerably and class 
structures were more flexible. At the same time, a clearer focus 
on excellence was evident and students generally appeared more 
task-oriented and goal-directed. Despite the strain experienced 
by staff in effecting such a major shift by project end, teachers 
and administrators appeared positive and committed to the changes 
they had wrought, encouraged by the evidence they were receiving 
of project success. 

Achievement of students in the school at the end of the project 
tended to be equivalent to achievement levels in both local and 
provincial programs. The exceptions were Math 30 in which project 
students* achievement was significantly higher than control groups 
and English 30 in which project students' achievement was signifi- 
cantly lower than control groups. With only one year of Grade 12 
results available for analysis by the end of the study, it was not 
possible to draw any significant conclusions about achievement in 
this model. 
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The curricula offered to students met with provincial requirements 
in terms of standards and content. Time was removed as the 
critical variable in awarding credit although student perceptions 
were negatively affected toward the end of the project by 
tightened administrative policies. Competency became the basis 
for awarding credit. While the program needs at least two more 
years to stabilize and mature, the components of a time-credit 
alternative have been successfully put in place and staff should 
be commended for their commitment and tenacity in achieving 
Project ABC goals. 
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CHAPTER S - OVERALL STUDY FINDINGS 



The purpose of this chapter is to assess the success of the three 
project models in providing their students with acceptable alter- 
natives to traditional time-credit relationships with regard to 
student achievement, curriculum adherence, removal of time as a 
credit requirement and the utilization instead of competency as 
the basis for awarding credit. Further, a discussion regarding 
province-wide application of project principles will be advanced 
and, finally, some budget considerations for a Project ABC-type 
program will be outlined. 

Student Achievement 

The evaluation goal regarding student achievement stated that 
prpject students' achievement was to be as good as or better than 
achievement levels in both local and provincial programs. Speci- 
fically, research questions asked the following: 

1. What changes occurred in the achievement of project students 
during the course of the project? 

2. How did achievement levels of project students compare mth 
those of non-project students within the system and within the 
province? 

With regard to changes in achievement of project students over 
time, little significant change was recorded. Out of a total of 
44 courses tracked over time, the mean scores in only three 
courses, one in each model, changed significantly during the 
project. 

In the Department-based Model, there was a significant decrease in 
students' mean scores in Accounting 30 from 1984 to 1986. In the 
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Parallel Core Program Model, there was a significant increase in 
Chemistry 30 mean scores from I986 to 1987. In the School-wide 
Model, mean scores increased significantly in Math 30 from I986 to 
1987. 

With regard to achievement level comparisons between project 
students and their peers within the system and within the pro- 
vince, again few significant differences were identified. 
(Consult Table 13). 

Out of 12 mean score comparisons in the Department-based Model, 

only three mean scores of project students were significantly 

different from their peers in the control groups. In, 1985, 

students' achievement for Typing 30 was significantly lower than 

the achievement of students in the system and the province while 

achievement for Law 30 was significantly higher. In I986, 

achievement for Accounting 30 was significantly lower than the 

achievement of the control groups. The other 9 mean score compar- 

♦ 

isons yielded no significant differences. 

In the Parallel Core Program Model, out of 21 mean score compari- 
sons, only one course in one year was significantly different. In 
1987, students* achievement in Chemistry 30 was significantly 
higher than the achievement of students in the system and the 
province. The other 20 mean score comparisons yielded no signifi- 
cant differences. Generally, course achievement levels in the 
Parallel Core Program Model tended to be somewhat higher than the 
achievement of control groups although not statistically signi- 
ficant. 

Comparisons were limited in the School-wide Model as the program 
developed to the Grade 12 level only late in the study. Three 
courses were compared for two years and five courses for one 
year. In 1987, students' achievement in Math 30 was significantly 
higher and in English 30 significantly lower than the achievement 
of control groups. The other nine mean score comparisons yielded 
no significant 6iCferer:ce6 . 
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TABLE 13 

STUDENT ACHIEVEMENT MEAN SCORE COMPARISONS OF 
PROJECT MODELS WITH CALGARY BOARD OF EDUCATION 
AND PROVINCE OF ALBERTA MEAN SCORES 
PROJECT ABC 

1983-1987 



MODEL 


0 MEAN 
COMPARISONS 


MEAN SCORE 
SIGNIFICANTLY 

HIGHER THAN 
CONTROL GROUPS 


MEAN SCORE 
SIGNIFICANTLY 

LOWER THAN 
CONTROL GROUPS 


DEPARTMENT-BASED 'AODEL 


12 


LAW 30 (1985) 


TYPING 30 (1985) 








ACCOUNTING 30 (1986) 


PARALLEL CORE PROGRAM MODEL 


21 


CHEMISTRY 30 
(1987) 




SCHOOL-WIDE MODEL 


11 


MATH 30 (1987) 


ENGLISH 30 (1987) 


TOTAL 


44 


3 


3 



12 9 



- 106 - 



To conclude, achievement levels in Project ABC courses did not 
appear significantly affected by program changes resulting from 
either the removal of time as a credit requirement or the use of 
individual competency as the basis for awarding credit. While 
achievement levels in the Parallel Core Program Model tended to be 
somewhat higher than that of control groups and achievement levels 
in the Department-based Model tended to be somewhat lower, 
achievement data were too limited in the School-wids Model to 
determine tendencies in that model. 

Curriculum Adherence 

The evaluation goal regarding curriculum adherence simply stated 
that the Alberta Curriculum be adhered to in project schools. 
This report was to serve as the means of informing Alberta Educa- 
tion about curriculum adherence. The research question on this 
topic asked the following: 

Did the curriculum offered to project students adhere to the curricu- 
lum requirements of Alberta Education? 

Throughout the project on an annual basis consultants from Alberta 
Education validated project curricula by determining the following 
two facts: 

1. If the content of each course matched the Program of Studies for Senior 
High Schools. 

2. If the standards applied in each course were comparable to those applied 



Based on the reports submitted by these consultants, it can be 
concluded that the content of all Project ABC courses either 
matched the Program of Studies for Senior High Schools or did not 
differ significantly. Further, standards in all project courses 
were found to be comparable to those applied generally across the 
province. 



generally across the province. 
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Several unanticipated outcomes were noted which relate to curri- 
culum. The first was the high degree of congruence between prov- 
incial requirements and project courses. It was evident that 
teachers had referred extensively to their curriculum guides in 
the generation of new materials and that they tended to be more 
confident than non-project teachers about their adherence to 
provincial requirements. 

A second unanticipated outcome related to the quality of materials 
prepared. In some cases, particularly in the Parallel Core 
Program Model, materials were found to exceed provincial require- 
ments and to exemplify curricular excellence. 

Two other indirect but related outcomes were identified in the 
1987 policy Delphi Study. ^ In their quest to develop individu- 
alized materials, teachers experienced professional growth through 
increased exposure to new ideas and increased opportunity to 
experiment. Delphi panelists also perceived that students had 
gained responsibility, independence and confidence because of the 
requirements the individualized content placed on them. 

To conclude, the development of individualized materials in 
Project ABC did not have a negative effect on either the content 
or standards of courses offered, and in fact in some cases, parti- 
cularly with regard to the Parallel Core Program Model, materials 
were judged to be superior. 



Removal of Time as a Credit Requirement 

The evaluation goal regarding time use stated that time was to be 
removed as a requirement in awarding credit. The research ques- 
tion asked the following: 

To what extent was time removed as a requirement for obtaining 
credit? 
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The key concepts or variables identified as critical to this goal 
included: 

1 . stop Mechanism 

2. Learning Rate Compatible with Ability 

3. Flexible Entrance to Next Course Level 

For the suminative analysis, these three variables were subjected 
to a univariate analysis of variance of the related student 
questionnaire responses in 1987 comparing responses among the 
three models. The program employed was the SPSS ONEWAY with post 
hoc testing. Consult Appendix 4 for statistical findings. 

The provision of a stop mechanism for students encountering diffi- 
culty was evident in all three Project ABC models according to 
student, teacher and administrator perceptions. Opportunity was 
provided for greater one-on-one interaction between students and 
teachers than is found in the traditional classroom due to both 
exemption from Carnegie Unit restrictions and the individuali- 
zation of instructional materials. The increased contact between 
students and teachers resulted in improved communication and 
higher satisfaction for both groups. 

Flexible course entrance was available to students in both Depart- 
ment-based and School-wide Models. In both cases, once a student 
had demonstrated satisfactory achievement of course requirements, 
entry to the next course level was possible. The Parallel Core 
Program Model did not provide this option to students as the 
concept of continuous progress was not adopted in this school. 

Varied learning rates were addressed in both Department-based and 
School-wide Models although, in both models, variability was more 
evident to teachers and administrators than it was to students. 

In the Department-based Model, general deadlines were provided to 
guide students through their courses. Those who could complete a 
course in less time were encouraged to do so. Those who took 
longer than the norm were handled on an individual case basis. 
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In the School-wide Model, policies were developed to provide for 
learning rate variability in six-week blocks. In other words, a 
student had the chance to complete a course and start the next 
level every six weeks. Although most students continued to take a 
full semester to complete a course, early completion was also 
evident. Students could be granted a six-week course extension 
(or even more time after extensive consultation) if they could 
demonstrate that they were on task. Implementation of the six- 
week extension policy was tightened in the last year of the 
project when it was found that some students were expecting an 
extension rather than earning it and this tightening was perceived 
negatively by students. It will take more time before the new 
administrative expectations are assimilated. 

Varied learning rates were addressed in the Parallel Core Program 
Model within the individual unit. Students had a great deal of 
flexibility in determining how much time they spent on each of 
their core courses at the unit level and variability of time on 
task was great. However, students could not vary their learning 
rate in terms of the semester or year because the group progressed 
together from unit to unit. For students completing their work 
early, enrichment was provided. For those requiring longer than 
the norm, remedial work was provided concurrently with progression 
to the next unit. 

A major unanticipated outcome which emerged from the project with 
regard to the removal of time as a credit requirement was the 
different use of time which developed in the Parallel Core Program 
Model. The program broke the Carnegie Unit because the number of 
hours a student spent during the school year on a particular 
course tended to vary from the traditional 125 hours based on a 
student's perceived learning needs. However, the student was held 
in a lock-step format as the class progressed from unit to unit, 
and so time use remained traditional from the perspective of the 
school year. 
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A second unanticipated outcome was the variety of policies and 
procedures which were developed by staff to handle time use with 
regard to varying learning rates. Each school developed a unique 
approach to the deregulation of time. Rather than converging over 
time, each program became more distinct. 

To conclude, all three models provided evidence that they had 
functioned outside of the restrictions of the Carnegie Unit, 
allowing students more or less time as their learning needs dicta- 
ted. However, while the Department-based and School-wide Models 
provided for continuous and individualized progress from unit to 
unit and from course level to course level, the Parallel Core 
Program Model did not adopt continuous progress as a delivery 
system but focussed on enrichment instead. 

Competency as the Basis for AwardiriQ Credit 

The evaluation goal regarding competency stated that competency 
was to be made the basis for awarding credit. The research 
question asked the following: 

To what extent was competency established as the requirement for 
obtaining credit? 

The key concepts or variables identified as critical to this goal 
included: 

1. Test use at the unit level 

2. Demonstrated competence before proceeoing to the next unit 

3. Advancement based on competency, not time 

For the summative analysis, these three variables were subjected 
to a univariate analysis of variance of the related student 
questionnaire responses in 1987 comparing responses among the 
three models. The program employed was the SPSS ONEWAY with post 
hoc testing. Consult Appendix 4 for statistical findings. 
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The use of tests at the unit level was evident in all three 
Project ABC models^ according to student, teacher and adminis- 
trator perceptions. In all cases, students had a degree of choice 
in determining when they would write their tests and also, in all 
cases, the testing function was separated from the instructional 
one. The Parallel Core Program and School-wide Models had 
separate test centres while the Department-based Model had a 
designated space in the open area for testing. Test administra- 
tion and filing were hanvUed by paraprofessionals or parent volun- 
teers. In many cases, multiple versions of tests were developed 
and each model developed its own security measures. Despite a 
perceived increase in workload for teachers facing a variety of 
tests requiring marking daily, they were generally satisfied with 
the separation of the testing function and supported student 
choice in determining timing. 

At the unit level, students were required to show subject matter 
competency before advancing to the next unit in the School-wide 
Model. Views differed in the Department-based Model on this 
topic. Teachers and administrators agreed that competency was 
required but students perceived this to be the case only some- 
times. There appeared to be a relationship between the nature of 
the curriculum and the competency requirement. In courses where 
material was non-sequential, students could redo successful units 
at the end of the course and in those cases advancement to the 
next unit was not competency-based. In the Parallel Core Program 
Model, while competency was a great concern to teachers, indivi- 
dual advancement based on competency at the unit level was not 
permitted. 



The replacement of time spent in a course with student competency 
as the criterion for advancement was successfully effected in both 
the Department-based and School-wide Models. In the Parallel Core 
Program Model, student competency was the criterion for awarding 
credit but individual advancement to the next course level was not 
possible. Instead, student selection procedures, extensive one- 
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on-one interaction between students and teachers, and the develop- 
ment of materials to address varied learning styles were all ways 
in which student success in the program was fosterea. 

A major unanticipated finding was the perception by policy Delphi 
panelists that teachers were experiencing greater job satisfaction 
due to their ability to meet individual student needs. ^ This was 
coupled with the panelists' perception that a major positive 
impact on students was the opportunity for increased contact with 
their teachers on a one-on-one basis. 

To conclude, competency became the basis for awarding credit in 
the School-wide Model. It was also the case to a large extent in 
the Department-based Model, although some non-sequential materials 
were handled differently at the unit level. In the Parallel Core 
Program Model, competency was the criterion for awarding credit 
within the traditional parameters of semester or school year but 
there was no provision made for individual advancement at either 
the unit or course level. Appropriate student selection and a 
variety of excellent instructional techniques helped to ensure 
that students would succeed within the time limits provided. 

Considerations for Provincial Application 

The evaluation goal with a provincial focus states that Alberta 
Educa*-l:.n be provided with information for use in the considera- 
tion of province-wide application of alternatives to time credit. 
Initially, no research questions were developed on this goal but 
in 1987 the Project ABC policy Delphi Study helped to provide this 
information. The Delphi panel consisted of 21 Project ABC 
teachers and administrators. Research questions developed for 
that study were as follows: 

1. What benefits accrued to project schools as a result of Project 
ABC? 
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2. What disadvantages or problems resulted in project schools 
because of Project ABC? 

3. What changes would project staff recommend if they yvere doing 
the project over again? 

4. What essential components would another school or school 
system need to set up an alternative to time-credit program? 

In addition , Alberta Education consultants who were reviewing 
Project ABC curricula were asked two additional questions in 1987 
which were: 

1. Are the methodological approaches used in this course educa- 
tionally sound? 

2. Could this course/program be offered in a similar manner in 
another school in Alberta? What critical factors would have to 
be taken into acc )unt? 

The considerations advanced in this section are based on data 
collected for these unique final year activities as well as data 
from the formative evaluation activities conducted in 1987,^ 

Project Benefits 

Benefits were divided into three groups: benefits for students, 
benefits for teachers and benefits for project schools. 

The most important benefits accruing to students because of their 
involvement in Project ABC as perceived by staff are listed below. 
(The mean response on the Delphi is indicated in parentheses to 
show strength on a Likert-type four-point scale where 1 = Most 
Important and 4 = Not Important,) 

K Opportunity for students to assume more responsibility for their 
learning, (Mean = 1.3) 

2, Opportunity for increased one-on-one student contact with teachers 
(Mean = 1.4) 

3, Development of student independence and confidence. (Mean = 1.4) 

4, Availability of alternatives for different learning styles. (Mean = 1.6) 
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5. Opportunity for students to learn at their own rate. (Mean = 1.7) 

6. Availability of different learning environments. (Mean = 1.8) 

7. Availability of different learning materials. (Mean = 1.9) 

Student interviews conducted in 1987 revealed support for all of 
the above-mentioned benefits. They were particularly satisfied 
with the opportunity afforded them to learn at their own rate and 
to work one-on-one with their teacher judging from the frequency 
of their comments. 

The most important benefits to teachers were identified by project 
staff as including: 

1. Increased freedom and opportunity to experiment outside of the tradi- 
tional delivery system. (Mean = 1.5) 

2. Increased exposure to new ideas. (Mean = 1.6) 

3. Development and continued evolution of a body of curricular materials. 
(Mean = 1.6) 

4. More teacher involvement in decision making. (Mean = 1.7) 

5. Greater teacher satisfaction due to their ability to meet individual 
student needs. (Mean = 1.8) 

6. Increased awareness of different teaching styles. (Mean = 1.8) 

7. Increased teamwork among teachers. (Mean = 1.8) 

8. Increased funding for staff development. (Mean = 1.9) 

9. Increased awareness of different learning styles. (Mean = 1.9) 

Teacher interviews conducted in 1987 supported these perceived 
benefits with particular support given to awareness of different 
teaching styles, increased satisfaction and increased opportunity 
to experiment. Comments by Alberta Education consultants indi- 
cated that not only were teachers aware of different teaching 
styles, they were demonstrating them effectively in the classroom 
and should act in the future as in-service leaders to pass on 
these well-developed skills. Administrators and teachers at 
William Aberhart High School agreed that even though the English 
Department's short-term involvement in Project ABC was judged to 
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be unsuccessful, the teachers gained some long-term benefits in 
terms of more varied teaching styles and a greater willingness to 
adopt new ideas. 

The most important benefits accruing to project schools were 
perceived by staff to include the following: 

1. The promotion of an atmosphere of cooperation between staff and students. 
(Mean = 1 .7) 

2. Increased funding for the school. (Mean = 1.9) 

3. Effective experimentation with and use of paraprofessionals. (Mean = 
2.0) 

Teacher interviews indicated particular support for the added 
resources the schools had obtained through involvement in the 
project. Particular benefits identified included the parapro- 
fessionals, improved library resources and additional computers, 
materials and other instructional equipment. 

Project Problems 

The most serious problems or dis?>dvantages experienced by students 
in Project ABC as perceived by staff are listed below. (Again, a 
four-point Likert-type scale was employed where 1 = Most Serious 
and 4 = Not Serious. Note that the means are lower than those for 
program benefits.) 

1 . Lack of understand i ng about the demands of the program by students . 
(Mean = 2.4) 

2. Lack of student responsibility in completing courses by the end of the 
semester. (Mean = 2.5) 

3. Poor student response to the freedom allowed in the program. (Mean = 
2.6) 

4. Increased amount of cheating in the test center. (Mean = 2.7) 

Student interviews supported the third problem area as over one- 
third of Grade 12 students interviewed identified the biggest 
disadvantage they had encountered in the project was the ease with 
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which one could fall behind and the difficulty involved in 
catching up again. 

The most serious problems or disadvantages encountered by 
teachers, according to the perceptions of Delphi panelists, 
included the following: 

1. stress, frustralion and burnout. (Mean - 2.1) 

2. Increased workload. (Mean = 2.2) 

3. Vague vision, goals and incentives. (Mean = 2.5) 

4. Lack of understanding about the demands of the project. (Mean = 2.6) 

5. Loss of confidence in leadership. (Mean = 2.6) 

6. Lack of consultation. (Mean = 2.9) 

7. Staff turnover. (Mean = 3*0) 

Throughout the project, stress and increased workload were 
observed on the part of project teachers; however, for the most 
part it must be emphasized that their commitment level was a good 
deal higher than their frustration level, particularly once bene- 
fits to students became apparent and once initial curriculum 
development had been achieved. With regard to clarity of goals - 
throughout the project, there was an underlying current of opinion 
among teaohers at Ernest Manning High School that the School-wide 
Model should actually provide for a non-project stream. This 
issue was never fully resolved to their satisfaction as they were 
evenly divided on the issue identified by the policy Delphi, "Is an 
ABC program appropriate for every student?" In their final inter- 
views, six out of nine teachers at that school still believed that 
students should have a choice. 

The most serious problems or disadvantages experienced by project 
schools were as follows: 

1. Need for extra clerical support. (Mean =2.1) 

2. Need for exira funding for aides, paper, word processing and photo- 
copying. (Mean = 2.3) 
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3. Lack of strong leadership. (Mean = 2.5) 

4. Public relations difficulties with feeder junior high schools, 
(Mean = 2-5) 

5. Low morale. (Mean = 2.6) 

6. Unequal distribution of class loads. (Mean = 2.8) 

7. Unclear priorities. (Mean = 2.8) 

8. Poor public relations with parents. (Mean = 2.8) 

9. Integration of the Teacher Advisor system with the project. (Mean = 3.0) 

Inter\;iews with project administrators in 1987 indicated that the 
project required more complex management of resources in terms of 
space, staffing and materials. A number of the other problems 
identified here, such as poor public relations, tended to be of a 
developmental nature and many were in hand by the end of the 
project. 

Essential Components for an Alternative Program 

Data collected in the policy Delphi study for the two research 
questions related to recommended changes and essential components 
tended to overlap and so were reported together under the topic of 
essential components. A list of key components for a Project ABC- 
type program was generated by Delphi panelists. These are out- 
lined below in descending order of importance along with other 
supporting evidence and observations collected over the course of 
this study. 



KEY (X)MPONENT 



(X)MMENTS 



1. Special ly selected 
teachers 



The Delphi also produced a list of 
critical teacher characteristics which 
includes the following: 



(a) Willing to make changes. 

(b) Prepared to work hard. 

(c) Receptive to new ideas. 

(d) Energetic and enthusiastic* 

(e) Flexible. 

(f) Willing to be part of a team. 

(g) Supportive of project philosophy^ 
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KEY COMPONENT 



COMMENTS 



I . Special ly selected 
teachers (continued) 



In both interviews and informal discus- 
sions, adm i n i strators strong I y 
supported the need to select their own 
staff. 



Support and commitment 
from the local board and 
government 



Alberta Education consultants most 
frequently mentioned teacher commitment 
as a critical factor in program repli- 
cation. It was also suggested that 
transfer out of an alternative program 
should carry no stigma. 

A I berta Educat ion consu I tants i dent i - 
fied a committed system administration 
as a critical factor. 



They also identified community support 
as another critical factor. 



Adequate time for 
curriculum development 
and revision with 
suf f icient lead time 
prior to program 
initiation 

Strong, decisive and 
creative leadership at 
both department and school 
I eve I s 



Strongly supported by Alberta Education 
consultants. 

Development of test banks to complement 
courses or at least parallel versions 
of tests were also supported. 

This complements the problem area 
ident i f ied el sewhere i n the Del ph i 
related to lack of strong leadership. 



5. A sound educational base 



Educational theory remained important 
throughout the study and was reflected 
in the ongoing need for staff develop- 
ment and orientation. 



An effective student 
tracking system to monitor 
progress and provide 
feedback 



Clear and consistent 
policies, expectations and 
consequences for students 



I ncreased work I oad observed throughout 
the project. 

Individual ized instruction necessitated 
new tracking and record keeping 
systems, a number of which were devel- 
oped successfully on the computer. 

Student orientation and a phase-in 
period seemed to be essential to smooth 
program operation. 

Teachers found that students required a 
certain amount of re-learning each year 
about time management skills, organiza- 
tional approaches and school policies. 
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KEY CX>MPONENT 
A school-wide philosophy 



COMMENTS 

This was reflected in the need for a 
clear vision and goals shared by al I 
staff ♦ An outstanding i ssue was 
whether or not the program should be 
for al I students* 



Adequate clerical and 
support staff 



Differentiated staffing was well 
implemented in this project to support 
the process of individualization* 

Alberta Education consultants saw 

clerical assistance and support staff 

in both the library and test centre as 
critical factors. 



Adequate teacher in- 
servicing, professional 
development and release 
time for planning and 
coordination 

Sufficient funding to 
institute and maintain 
the program 



Adequate one-on-one 
interaction with students 



New teacher orientation was viewed as 
critical by administrators. 

Alberta Education consultants supported 
ongoing in-service and release time* 



Start-up costs were perce i ved 
different from maintenance costs. 



as 



Lack of adequate start-up costs was 
seen as a factor in the failure of the 
Engl ish Department's venture into an 
alternative program at William Aberhart 
High School. (Also consult Financial 
Considerations, below.) 

The experience with the drop in enrol- 
ments in the Business Education Program 
at William Aberhart High School seems 
to indicate that there is a minimum 
number which must be served by such a 
program to provide for adequate 
s.'-udent-teacher interaction. It is 
possible that a maximum number also 
exists. 



Involvement of total 
school staff in program 
development 



A flexible timetable 



Good liaison with feeder 
schools 



Teacher involvement in decision making 
was perceived as a benefit and a number 
of teachers exper ienced prof ess iona I 
growth as a result. 

Close links maintained between PEP and 
Non-PEP teachers at John G. Diefenbaker 
High School dispensed with a lot of 
potential communication problems. 

This component was handled individually 
by each model which suggests the 
conclusion that the timetable should 
emerge from the needs of a spec I f i c 
mode I * 

As the models matured, they became more 
aware of public relations needs outside 
the school . This is en ongoing 
chal lenge. 
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KEY COMPONENT 

16. Contact with experienced 
staff in similar programs 
and sufficient research 
prior to program implemen- 
tation 



17. Clear and consistent 

communication with parents 



18. Extra funding for 
photocopying and 
word processing 

19« Gradual implementation of 
the alternative program 



20 ♦ Student choice between 
the alternative and a 
traditional program 



COMMENTS 

While the out-of-country travel 
supported by this project wilf not 
likely be repeated, schools initiating 
simi lar projects can benef it from 
information provided in this document 
and by contact with staff members in 
the three Project ABC schools. 

Aga i n , commuo i ty support was c i ted by 
Al berta Education consul tants as a 
critical factor. 

As the models matured, their relations 
with parents became clearer and nore 
pos i t i ve . 

As s"^ated in No. 11 above, maintenance 
costs were seen as essential* 



The experience of two of the model s 
ind icated that it was aopropriate to 
develop the program in one grade at a 
time. 

As mentioned above, this component 
remained unresolved* In the Parallel 
Core Program Model, support was unani- 
mous for a two-stream approach. In the 
School-wide M<^del, Delphi panelists 
were evenly divided. Results were also 
divided from the Dep^^rfment-based Model 
but with only two paneMsts involved, a 
conclusion could not oe drawn. 



One final critical component which was not identified in the 
policy Delphi, but which emerged from both the comments of Alberta 
Education consultants and final-year interviews with tcjachers, 
administrators and students, was the need for a flexible f-, xlity 
with different-sized instructional spaces. 

To conclude, information has been provided in this section for the 
consideration of Alberta Education in terms of province-wide 
application of alternatives to time credit. Project benefits drew 
higher mean scores from Delphi participants than did project 
problems or disadvantages highlighting the perceived overall value 
attributed to the project. The project benefits receiving highest 
mean scores were those related to students, followed by benefits 
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to teachers and, finally, benefits to the schools. A list of 20 
key components for a Project ABC-type program was developed. The 
most critical item identified was the need to select teachers 
based on specific characteristics. 



Budget Considerations 

For any school contemplating the initiacion of a Project ABC-type 
program, there are primary budget considerations to be 
address?d . These programs are different ; therefore , different 
approaches to budgeting should be carefully considered before 
setting out in new directions.^ 

The essence of the program difference lies in the terms person- 
alizing or individualizing the educational delivery system. If 
students are to proceed only when and if they are competent to 
proceed, then it follows that large groups of students travelling 
together at a teacher-directed pace will conflict with the concept 
of advancement based on competency. By emphasizing the uniqueness 
of each student there must be a different emphasis in the school 
budget. The main areas affected include resources, staff and the 
budgeting philosophy. 

Resources 

There are two main types of resources affected by a Project ABC- 
type program, namely instructional materials and information 
processing facilities and supplies. 

As the class set of texts approach is not appropriate for an 
individualized program, instructional materials available need to 
be expanded. In the first place, students must have access to a 
broader range of materials if they are to investigate personal 
initiatives as opposed to teacher-directed ones. Secondly, the 
individualized delivery system requires that more copies of audio- 
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visual resources be' available. Finally, increased use of 
resources requires stepped-up security and results in increased 
maintenance. 

Because the curriculum is rewritten into smaller chunks and is 
cast into a variety of learning style formats, and because record 
keeping needs are more complex, demands on information processing 
facilities in the school are greatly increased. In the first 
place, teachers and administrators require greater access to 
computers and word processors than is the case in a traditional 
program. Secondly, photocopying becomes a major activity and 
facilities may need to be upgraded to ha.idle the volume. And 
thirdly, related to both of the above, paper costs can be expected 
to rise substantially. 

Staff 

Staff costs are increased in three different ways. The first is 
an incre?.^«=>d requirement for paraprofessional and clerical support. 
For student tracking, the organization and production of 
materials, test supervision, and lab work coordination, non- 
instructionai personnel have proven to be invaluable, freeing 
teachers address the myriad of instructional demands placed 
upon them by an individualized program. 

Secondly, professional development is essential. Even with 
specially selected staff, as is recommended in thi, report, 
professional development is required to clarify and solidify the 
philosophical underpinnings of personalized and individualized 
education. In addition, curriculum rewriting is a complex task 
and may require support from knowledgeable professionals. There 
is also an ongoing orientation component to be aware of. Every 
new teacher to the team requires sc.ie intensive, fast tracking 
professional development to allow them to catch up with their 
colleagues. 
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Finally, initial teacher release time for curriculum development is 
necessary to allow the transition to take place. Project schools 
found it more effective to add an extra staff member to a 
department temporarily who could release colleagues for curriculum 
development for large chunks of time, such as six weeks at a 
stretch, rather than trying to replace teachers with substitutes 
on a day -by-day basis. Although most of the cost for curriculum 
development is up front, there are some minor ongoing release time 
costs for planning and curriculum revision. 

Budgeting Philosophy 

For a school to be successful in implementing the above-mentioned 
budget changes, it appears that a system budgeting model may be 
unsuitable if too many system considerations are overriding. This 
suggests that a school-based decentralized budgeting model is more 
appropriate. This is particularly true with regard to determining 
the number and type of professional, paraprofessional and clerical 
staff required to run the program. A decentralized budget would 
allow some differentiated staffing and resource management 
decisions to be made at the school level. 

Five years of experience in Project ABC have led school adminis- 
trators to conclude that implementing a Project ABC-type program 
has some budgetary implications. More resources are required in 
the areas of instructional materials and information processing. 
Staff costs include an increased requirement for professional 
development and new staff orientation, release time for initial 
curriculum development and ongoing curriculum revision, and an 
increased need for paraprofessional and clerical support. How- 
ever, the implementation of a decentralized budgetary model can 
allow these more complex resource management issues to be resolved 
at the school level. 
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CHAPTER 6 - SUMMARY, CONCLUSIONS, 
RECOMMENDATIONS AND IMPLICATIONS 



This final chapter presents a brief summary of the evaluation 
stviy for Project ABC and some conclusions based on study find- 
ings • Recommendations emerging from the study are presented and 
are followed by some of the implications of Project ABC. 

Study Summary 

Project ABC: Advancement Based on Competency was a five-year study 
conducted from 1982-1987. It was funded jointly by Alberta 
Education and the Calgary Board of Education for a total of 
$999,950. 

Purpose 

The purpose of Project ABC was to explore alternatives to the 
Carnegie Unit in three Calgary high schools. It provided these 
schools with the opportunity to remove the fixed time-credit 
relationship and to replace it with continuous progress based on 
individual competency, A formative evaluation was conducted in 
each of the study's five years and this summative evaluation was 
completed at the end of the project. 

Background 

The Carnegie Unit was established in 1907 to regulate the distri- 
bution of college pension funds but quickly came to standardize 
the quality of high schools in North America. Currently in 
Alberta, one credit requires a minimum of 25 hours of instruction; 
thus J a five-credit course requires a minimum of 125 hours of 
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instruction. It has long been felt, however, that more or less 
than the 125 hours might be more appropriate for an individual 
student's learning needs than the traditional requirement, 

A review of the literature revealed that the idea of breaking the 
Carnegie Unit occurred as early as 1932. A long-buried study 
entitled the Eight-Year Study was conducted in the United States 
from 1932-19^0, funded by the Carnegie Corporation and the 
Rockefeller Foundation, It explored ways of improving high school 
effectiveness and experimented with flexible time use in the high 
school. Thirty schools across the country were released from the 
usual subject and unit requirements for college and university 
admission for a period of eight years. Each school developed its 
own model . Some of the innovations which emerged included a 
school-determined curriculum , student-centred instruction , 
increased student challenge, a Teacher Advisor system, joint 
decision making by teachers and administrators, increasec parent 
involvement and careful evaluation. Thx3 students were also 
followed through their university careers and were found to earn 
Higher grade averages than their control groups in all subject 
areas but foreign languages. Another interesting outcome was the 
higher percentage of non-academic honours earned by these students 
who were judged to be more motivated, resourceful, objective and 
aware than their peers. It was concluded that departures from the 
prescribed patterns of both time use and curriculum did not lessen 
the students' readiness for college and, in fact, that the more 
fundamental the changes initiated by the high school the better 
the students achieved in college. 

A teacher from one of the original 30 schools came to influence 
Project ABC indirectly. J. Lloyd Trump went on to direct the 
Model Schools Project for the National Association of Secondary 
School Principals in I968, One of those schools was Bishop 
Carroll High School in Calgary which served as a reference for 
Project ABC. 
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Project ABC evolved from an interest held by Alberta Education in 
exploring alternatives to the Carnegie Unit and by a perceived 
need by the Calgary Board of Education to address the needs of 
dysfunctional students whose needs were not then being met by the 
high school. 

Each of the three high schools involved in Project ABC developed 
its own model and each is outlined in turn. 

DEPARTMENT-BASED MODEL - WILLIAM ABERHART HIGH SCHOOL 

BUSINESS EDUCATION PROGRAM 

The Department-based Model was housed in an attractive carpeted 
open area in an upstairs wing of William Aberhart High School. 
The individualized instruction and continuous progress employed in 
the delivery of the program enaoled all Business Education 20- and 
30-level courses to be offered simultaneously throughout, the day, 
thus accommodating the demands of most students' timetables. 
Students were able to progress from course levej. to course level 
as they completed course requirements. Teachers circulated in the 
open area discussing specific problems. A clerical aide provided 
support for material coordination and tracking and record-keeping 
activities. While the area could house lOG students at a time, it 
was seldom full by project end due to declining enrolments in che 
Business Education program. Causes for the decline were perceived 
to be largely external to the department and included implementa- 
tion of the Grade 12 Diploma Examinations and the recommendations 
of the Secondary Education Review, both of which encouraged 
students to focus on core curriculum areas. Further, within the 
school, the growth of the B-' lingual Program restricted students* 
involvement in option areas. The decline in enrolment threatened 
continuation of the open area as teachers began to be required to 
teach elsewhere in the school. Despite problems encountered by 
the program, it remained at project end viable in concept, mature 
and smoothly operating. 
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PARALLEL CORE PROGRAM MODEL - JOHN G. DIEFENBAKER HIGH SCHOOL 

PEP (PERSONALIZED EDUCATION PROGRAM) 

The Parallel Core Program Model operated in John G. Diefenbaker 
High School ani provided a school-within-a -school model for core 
courses involving approximately 100 students in each of Grades 10 
through 12. Students were selected for the program based on the 
results of a learning independence test , parent permission and 
student motivation. A combination of flextime and demand time was 
used by students co organize their school day according to their 
perceived learning needs for each of the core areas. Students 
attended regular classrooms for their option courses. Time 
management skills were stressed. A Teacher Advisor System was 
used to help with student tracking and communication . A test 
centre, staffed by parent volunteers, facilitated the program as 
did paraprofessional assistants in the Science Lab area and in the 
Math area. By 1987, 3^% of the school's population, or 350 
students were in this program. Throughout the project, students 
in the Parallel Core Program Model expressed significantly greater 
satisfaction than the control group of students in the school's 
regular program with the way the prograrii was set up, with teacher 
interest in students and with communication both with teachers and 
their peers. 

SCHOOL-WIDE MODEL - ERNEST MANNING HIGH SCHOOL 

PACE (PERSONALIZED AND CONTINUOUS EDUCATION) 

The School-wide Model at Ernest Manning High School turned a 
traditional comprehensive program into an individualized and 
continuous progress model for Grades 10 through 12. The project 
grew to encompass the whole school, although Grade 12 was opera- 
tional only during the final year of the project. Model implemen- 
tation was a vast undertaking and required a great deal of time to 
realign staff philosophy and define goals and processes. By 
project end, the school had provided students with a personalized 
learning environment where differing learning rates and different 
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learning styles were addressed. In most classr oms, at any one 
time, a variety of instructional methods could be observed, 
including lecture, small group discussion and independent work. A 
clerical aide managed the test centre with the support of parent 
volunteers, and a Teacher Advisor system fostered communication 
with students and their parents. The program was fully functional 
by the end of the project but needed more time to mature. 

Study Design 

A Steering Committee comprised of representatives from both 
Alberta Education and the Calgary Board of Education guicsd the 
evaluation of Project ABC and developed a series of evaluation 
goals, as follows: 

1 . Primary Goals 

To assess the success of project schools in providing students with 
acceptable alternatives to the time-credit relationships expressed in the 
current Junior and Senior High School Handbook where: 

(a) The student achievement level is as good as or better than achieve- 
ment levels, in both local and provincial programs. 

(b) The Alberta Curriculum is adhered to. 

(c) Time has been removed as a requirement in awarding credit. 

(d) Competency has been made the basis for awarding credit. 

2. Secondary Goal s 

(a) To provide project schools with information concerning students' 
educational experiences in terms of the principles of personalized 
instruction and continuous progress. 

(b) To provide Alberta Education with information regarding adherence to 
the Alberta Curriculum in project schools. 

(c) To provide Alberta Education with information for use in the 
consideration of province-wide application of alternatives to time 
credit. 

Further, several key concepts were defined by the committee. 
Personalize istruction was defined as including: 

1. Placement appropriate to learning style 

2. Varied learning environments 
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3. A "stop mechanism" for students to obtain assistance at any point in a 
course 

4. Oernonstrated competency in each unit of a course before proceeding to the 
next unit 

5. Opportunities for enrichment 

Continuous progress was defined as including: 

1. A learning rate compatible with ability 

2. Flexible timetabling to accommodate personal choice or need 

3. Advancement based on competency demonstrated rather than time spent in a 
course 

Later in the project, school personnel defined the concept of 
competency as follows: 

students must demonstrate a canpetency level of at least 501 in a unit or 
course before proceeding to the next unit or course. However, in certain 
cases, higher competency levels for particular units may be required 
(e.g.. Safety Unit in Chemistry). 

Based on these goals, a series of research questions was developed 
and an evaluf^.tion study was designed. There were two distinct 
parts to the evaluation: the formative evaluation which involved 
an annual cycle of evaluative activites culminating in an annual 
Formative Evaluation Report; and the summative evaluation which is 
presented in this document. 



The Formative Evaluation Reports (Years One to Five) focussed on 
the concepts of personalized instruction and continuous progress 
which were of particular interest to the schools' planning 
process. The reports provided feedback to the schools regarding 
their progression toward project goals. Students, teachers and 
administrators in both models and control groups completed attitu- 
dinal questionnaires. Perceptions which were significantly 
different among project groups formed the basis for interview 
questions for samples of the three participant groups in each 
model. The final grades of project students were compared to 
individual model control groups' grades as well as to system-wide 
and province-wide mean grades. The Summative Evaluation Report 
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presented here has focussed specifically on the evaluation goals 
identified by the Steering Committee which were of pa.^ticular 
interest to Alberta Education. Key variables were extracted from 
the attitudinal questionnaires administered from I9P3 to 1987 and 
were analyzed for changes over time and for differences among 
models in the last year of the project using univariate analysis 
of variance. In a similar way, achievement data of project 
students in 30-level courses were analyzed for change over time 
within each model and, in the final year, between project students 
and those in the system and the province. In addition, a policy 
Delphi study was conducted with a panel made up of project 
teachers and administrators. This provided additional useful 
background information which is reported here such as perceived 
project benefits and problems, important teacher characteristics 
and key components of an alternative to time-credit program. 

In brief, the Sunmiative Evaluation Report focussed on six main 
areas as follows: 

Student Achievement 

(a) Within each school over time 

(b) Between each school and the city and provincial control groups 

Curriculum Adherence 

(a) Content match 

(b) Standards comparability 

Removal of Time as a Credit Requirement 

(a) Use of a Stop Mechanism 

(b) Provision of flexible entrance to next level of a course 

(c) Course learning pace compatible with student ability 

Competency as the Basis for Awarding Credit 

(a) Usts of tests at the unit Jevel 

(b) Demonstration of competency at the unit level before proceeding 

(c) Advancement to the next course based on student competency, not time 
spent 

Considerations for Provincial Applications 
Budget Considerations 
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Study Findings 

What follows is a summary of study findings related to the six 
areas outlined above. 

STUDENT ACHIEVEMENT 

For the summative evaluation, student achievement scores ^or 
30-level courses in project schools were compared with the scores 
of all Calgary Board of Education students and all Alberta 
students registered in those courses using the computer program 
Statistical Package for the Social Sciences (SPSS-X) ONEWAY 
proced'ire, a univariate analysis of variance which identified 
significant differences between mean scores over time and between 
project mean scores and control group scores. This was followed 
by post hoc testing using the Scheffe procedure which helped to 
pinpoint those differences. 

Study findings indicated that sichievement levels of students 
within each program did not vary significantly over the course of 
the project. Achievement did tend to be somewhat higher in the 
Parallel Core Program Model and somewhat lower in the Department- 
based Model but not to a statistically significant degree. Enough 
data were not collected in the School-wide Model by project end to 
determine tendencies in achievement levels . Achievement levels 
did not appear to be negatively affected by program changes 
resulting from the implementation of Project ABC. Overall, 
achievement levels oi project students were generally comparable 
with achievement levels of non-project students in the Calgary 
Board of Education and the Province of Alberta. It was concluded 
that the project evaluation goal related to student achievement 
had been achieved and that student achievement levels in Project 
ABC were as good as achievement levels in both local and provin- 
cial pi'ograms. 
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CURRICULUM ADHERENCE 

Curriculum developed by Project ABC teachers was reviewed annually 
by consultants from Alberta Education to see if content or 
standards in project courses remained comparable to those across 
the province. In their opinion, the development of individualized 
materials did not have a negative effect on either the content or 
the standards of courses offered in Project ABC, and in some 
cases, particularly in the Parallel Core Program Model, materials 
were judged to be superior. It was concluded that the project 
evaluation goal related to adherence to the Alberta Curriculum had 
been achieved. 

REMOVAL OF TIME AS A CREDli REQUIREMENT 

Student perceptions regarding the removal of time as a credit 
requirement were collected through the administration of an annual 
questionnaire which measured their attitudes and perceptions. 
Teachers and administrators were also polled with questionnaires. 
A sample of each of the three groups was interviewed annually to 
help clarify the data Cvollect„:. For the summative analysis, the 
key concepts of use of a stop mechanism, provision of flexible entrance 
to the next course level and course learning pace compatible with student 
ability were extracted from the student questionnaire and analyzed. 
Descriptive statistics for these concepts were also extracted from 
teacher and administrator questionnaires. Interview data from the 
five Formative Evaluation Reports were also reviewed as were field 
notes based on school observation and other relevant documen- 
tation. 

The Department-based Model allowed students to stop and solve 
their problems as they were encountered and provided flexible 
course entrance. Variable learning rates were evident in the 
program but students taking longer than a semester to complete a 
course were treated on an individual case basis rather than by 
department policy. 
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The Parallel Core Program Model also allowed students to solve 
problems as they occurred in their learning. The program did not 
provide flexible course entrance because there was no continuous 
progress option available to students. Variable learning rates 
were evident within the individual course unit as students 
determined their own schef^ules based on perceived learning needs 
but students progressed from unit to unit together. 

The School-wide Model also provided a stop mechanism for students 
encountering difficulty. Evidence supported teacher and 
administrator perceptions that learning rate variability and 
flexible course entrance were in effect, although student 
perceptions were affected negatively to an extent by 
administrative policies about time use which were tightened near 
the end of the project. Additional time to study this program 
would have -allowed these policies to be assimilated and thereby 
would have clarified program perceptions. 

All three models were determined to be functioning outside of the 
traditional Carnegie Unit, allowing students more or less time 
than the 125 hours as their learning needs dictated. The 
Department-based and School -wide Models provided for continuous 
and individual progress from unit to unit and from course to 
course. The Parallel Core Program Model provided for variable 
learning rates within the unit but did not adopt continuous 
progress as a delivery system focussing instead on enrichment. It 
was concluded that all three models had removed time as a require- 
ment in awarding credit, although the Parallel Core Program's more 
structured approach to time had not been anticipated. 

COMPETENCY AS THE BASIS FOR AWARDING CREDIT 

Perceptions regarding competency as the basis for awarding credit 
rather than time spent in a course were treated in a manner 
similar to those outlined above. The key concepts included use of 
tests at the unit level, demonstration of competency at the unit level 

ERIC ^ 



- 134 - 



before proceeding, and advancement to the next course based on student 
competencyy not time spent. These were analyzed along with 
relevant interview data, field notes and documentation. 

The Department-based Model tested students at the unit level and 
ensured that students demonstrated competency in their course 
material before progressing to the next course level. Students 
differed in their opinion from teachers and administrators, 
however, as to whether students had to demonstrate competency at 
the unit level. There appeared to be a relationship between the 
natui^e of course content and whether competency was required for 
each unit; in particular, non-sequential material was presented in 
such a way that students could do make-up units at the end of the 
course and, in that case, their advancement to the next unit was 
not based on demonstrated competency. There did not appear to be 
a policy covering progression from unit to unit, rather it was 
determined by the individual teacher based on the nature of the 
course material . 

The Parallel Core Program Model also tested students at the unit 
level and ongoing evaluation was stressed. Individual advancement 
based on competency at both the unit and course levels was not 
perceived to be available by either students or teachers, while 
administrators were more positive in their perceptions regarding 
advancement at the unit level. Competency issues were dealt with 
in a variety of ways other than individual continuous progress 
including the following: one-on-one student interaction with 
teachers was increased due to timetable flexibility in the 
program; initial student selection procedures identified 
independent learners for the program; curricular materials 
addressed learning style differences; and a program policy for 
dealing with unsuccessful students moved them, once remediation 
had been attempted, to more appropriate courses or out of the 
program altogether. In these ways student competency levels were 
addressed by the Parallel Core Program Model although individual 
advancement in either unit or course was not encouraged. 
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The School-wide Model tested students at the unit level and 
requii'^ed competency to be demonstrated at both the unit and the 
course levels before students could advance. Students, teachers 
and administrators agreed in their perceptions about the success 
of this model in making competency the basis of awarding credit. 

All three models addressed competency issues as they related to 
non-traditional use of time. The School-wide Model was the most 
successful in terms of making competency the basis for awarding 
credit according to Project ABC criteria. The Department-based 
Model also made competency the basis for credit although some non- 
sequential material was handled differently at the unit level. 
The Parallel Core Program Model made competency the criterion for 
awarding credit within the traditional parameters of the semester 
or school year but did not encourage individual advancement Fit 
either unit or course levels. Appropriate student selection for 
the program and a variety of instructional techniques helped to 
ensure that students would succeed within allotted time limits. 
It was concluded that competency had been made the basis for 
awarding credit in the School-wide and Department-based Models but 
that individual advancement based on demonstrated competency was 
not encouraged in the Parallel Core Program Model. 

CONSIDERATIONS FOR PROVINCIAL APPLICATION 

In order for Alberta Education to consider province-wide applica- 
tion of Project ABC-type alternatives, a policy Delphi study was 
conducted in 1987 to poll participants^ views on project outcomes. 
Several identified project benefits were supported by interview 
data. In particular, students appreciated the opportunity to 
learn at their own rate and to work on a one-on-one basis with 
their teachers. Teachers and administrators also felt that 
students assumed more responsibility for their learning and 
developed confidence and independence. Teachers gained from the 
project as well in terms of increased freedom to experiment, 
greater awareness of different teaching styles and greater satis- 
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faction. Alberta Education consultants believed that Project ABC 
teachers had grown professionally from the experience. The 
greatest benefit to project schools to emerge was the promotion of 
an atmosphere of cooperation between staff and students. Schools 
also gained materially from their involvement in the project 
through increased funding which provided support for paraprofes- 
sionals and improved library resources. They also benefited from 
additional computers, learning materials and instructional equip- 
ment. 

The most serious disadvantages or perceived problems emerging from 
the project were rated lower by Delphi participants than perceived 
benefits, thereby highlighting the overall positive perception of 
the project. For students, the main disadvantage was the ease 
with which they could fall behind in their work. Teachers and 
administrators also felt that 3tudents sometimes lacked under- 
standing about program demands and how to handle them. For 
teachers, perceived disadvantages included the added stress and 
potential burnout associated with being part of an alternative 
project, increased workload, and frustration with unclear goals, 
particularly in the School-wide Model. Problem areas identified 
for schools included increased resource needs, more complex 
resource management and the need for strong leadership. 

Key components for an alternative to time-credit program were 
identified, the most critical of which included: 

1. Specially selected teachers who demonstrate the characteristics of 
openness to change, industry, recept i veness, energy, and flexibility, 
who are team players and who support the alternative philosophy. 

2. Support from the local board, the community and government. 

3. Adequate lead time for curriculum development and time for ongoing 
revision . 

4. Decisive leadership. 

5. A sound educational rationale coupled with adequate staff development 
ano new teacher orientation. 

6. Effective student monitoring, tracking and record keeping systems. 
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7. Clear and consistent policies, expectations and consequences for 
students. 

8. A school-wide philosophy and total school staff involvement in and 
commitment to the alternative program. 

9. Adequate clerical and paraprofessional support. 

10. Adequate ongoing teacher release time for planning and coordination. 

11. Sufficient funding to initiate and maintain the program. 

12. Adequate program si2e to maintain one-on-one interaction between 
teachers and students. 

13. Timetable flexibility, 

14. Good liaison with feeder schools. 

15. Good communication with parents. 

A final critical component was not identified in the policy Delphi 
but emerged from the perceptions of Alberta Education consultants 
and final-year interviews with students, teachers and administra- 
tors. This was the need for a flexible physical plant with a 
variety of instructional spaces available for large groups, semi- 
nars, and individual study as well as traditional classroom areas. 
In the two larger Project ABC programs, library space was enlarged 
or reorganized to meet the demands of individualized inscruction 
and traditional classroom spaces were converted into test centres. 

It was concluded that Project ABC-type programs could successfully 
be implemented in other schools and school jurisdictions. Based 
on the fact that three different models developed in this project 
and that similar diversity was experienced in the Eight-Year 
Study, it was also concluded that models should develop which were 
appropriate to school-based needs. The policy Delphi helped to 
pinpoint a nu.7iber of critical considerations for any school 
attempting a similar program, the most important of which was 
teacher selection. 
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BUDGET CONSIDERATIONS 

The different nature of a Project ABC-type program means that some 
budget considerations must be addressed before such a program can 
be developed. 

The first area is related to resources. Instructional materials 
need to be expanded to include a broader range and number of 
materials to meet the demands of an individualized program. 
Tightened security and increased maintenance costs are also 
required. Information processing facilities auch as computers, 
word processors, photocopiers, and of course paper are at a 
premium in this kind of a program. 

The second area where budget is affected relates to staff costs. 
There is an increased requirement for paraprofessional and 
clerical support in this type of program to assist with student 
tracking, the production and organization of materials, test 
-upervision and lab coordination. Professional development costs 
are affected by the need for staff training in the philosophical 
underpinnings of an individualized approach and in specific curri- 
culum areas. New teacher orientation is an ongoing cost. Release 
time must also be provided for initial curriculum development. 
There are minor ongoing costs for annual release time for revision 
and planning. 

It was concluded that in order to manage the more complex resource 
requirements of a Project ABC-type program, a decentralized 
budgeting model which includes staff resources is appropriate. 



Evaluator Perceptions 

Evaluating Project ABC over a five-year period was a unique 
research experience. As the models grew, the process became more 
complex, morp engrossing, more encompassing. The further the 
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e-tluation progressed, the greater the challenge became. As the 
three models evolved, there was a greater and greater demand for 
responsive evaluation techniques which could address changing 
needs. The original evaluation design was expanded to include 
extensive interviewing and on-site observation . The final-year 
policy Delphi was able to address issues which had not even been 
identified five years before. 

If the study process expanded far beyond initial expectations so 
too did study rewards. The formative nature of the evaluation 
process allowed for immediate feedback into planning. School 
administrators were kept apprised of annual study findings as they 
occurred and these then helped to guide goal-setting activities 
for the subsequent term or year. The Formative Evaluation Reports 
came to be eagerly anticipated as project goals grew closer. The 
evaluation process worked. 

The schools, too, found themselves challenged beyond initial 
expectations and their rewards increased as well. As each issue 
was resolved , three or four others would present themselves . 
Successful group decision-making processes proved to be critical 
to model development. As staff members discussed philosophical 
issues and methodological approaches, they were forging new 
visions for what a high school could be. Each of those visions 
was unique. 

Of the three models, the most traditional one was probably the 
Department-based Model at William Aberhart High School. And yet 
for Business Education instruction, it was a radical departure. 
The use of a real-life office environment had a profound effect on 
instructional processes and student expectations, Collegiality 
among staff members flourished. In a sense, however, the program 
did not provide an alternative; it was the only way Business 
Education was offered at that school. At a department level, it 
appeared that providing a choice in delivery systems was not 
feasible. Individual learning styles were not addressed, because 
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although materials were organized into unit packs, they presented 
instruction in one format only, namely "Read and Do." Students 
with special reading or language needs were unlikely to succeed. 
Subject areas such as Law lost some of the learning that occurs in 
a spontaneous class discussion. But for the most part, the 
skills-oriented Business Education courses transferred nicely to 
an individualized approach and students gained motivation through 
the freedom afforded them to work at their own rate. The model 
provided a viable learning alternative to traditional Business 
Education instruction. Too soon, however, the program had to face 
the harsh reality of a fa'^.tor beyond its control - declining 
enrolment. At project end, the program was jeopardized by pupils 
teacher ratios falling below the level at which the prcgram could 
be maintained and its future was uncertain. 

The Parallel Core Program Model placed the greatest strains on the 
evaluation process. Had a goal-free evaluation model been 
developed five years ago, problems might have been avoided but a 
definite set of goals had been developed and therefore had to be 
measured. What occurred was that as the program grew and pros^ 
pered, it charted a different course from the project main- 
stream. Continuous progress did not develop; instead, staff 
focussed on enrichment and learning styles. The tools developed 
to measure continuous progress were not appropriate for gauging 
what was actually happening at the school. Nevertheless, program 
excellence was evident and participant satisfaction was high, 
significantly higher in fact, than that of traditional students in 
the same school. The contextual component built into the evalua- 
tion process provided an opportunity to react to developing study 
needs and thus it was possible to measure actual student use of 
time during the school day. An increasing focus on interview data 
as the study progressed also permitted an exploration of percep- 
tions not measured by study instruments. In the end, it was clear 
that the program had broken the Carnt^gie Unit but had set up 
different parameters from the other two programs to regulate 
student movement through course material. The unquestionable 
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quality of the resulting program led to the conclusion that 
Project ABC-type programs were alternatives which were not neces- 
sarily appropriate for every student but which were very appro- 
priate for independent learners. The program also demonstrated 
that it could co-exist successfully with its traditional cou *:er- 
part and dispelled any notion of elitism by its success with non- 
academic students as well as high achievers. 

The School-wide Model took a long time to incubate. However, its 
slow generation proved to be valuable in the end because many 
constructive lessons were learned about implementing a Project 
ABC-type program. As Grade 10 shakily got off the ground in the 
third year of the project, there was more than one observer who 
questioned the p ssibility of ultimate success in terms of Project 
ABC goals. However, all the questioning, debating and self- 
analysis paid off in the long run, not in small part due to an 
administrative team who simply would not give up the vision. In 
the end, the pieces fell into place, and while certainly not yet 
perfect, Ernest Manning High School is now providing an alter- 
native to time-credit where competency, not time spent, is the 
critical factor. 



Conclusions 

What follows is a list of conclusions about Project ABC which have 
been drawn based on data collected over the five-year period 1982- 
1987. 

1. Achievement levels of Project ABC students were as good as 
student achievement levels in both local and provincial 
programs. 

2. The Alberta Curriculum was adhered to in all three Project 
ABC schools. In the Parallel Core Program Model, provincial 
requirements were exceeded. 

3. The three Project ABC schools successfully provided alterna- 
tives to the Carnegie Unit. 
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^. Project ABC demonstrated that competency rather than time 
spent in a course can become the basis for awarding credit. 

5. Personalized instruction and continuous progress are viable 
educational alternatives and should no longer be considered 
experimental . 

6. Program delivery can be successfully individualized, although 
the nature of the subject matter will have an impact on the 
degree to which individualization can occur. 

7. Models for a Project ABC-type program should emerge from the 
nature of the individual school and its community. 

8. This type of program is particularly appropriate for students 
who are independent learners. 

9. This type of program is best implemented by teachers who 
support and practise the projec*; philosophy. 

10. This type of program requires a clear program vision, commit- 
ment of the total school staff and strong administrative 
leadership. 

11. This type of program requires more complex financial manage- 
ment than a traditional program and involves both start-up 
and maintenance costs which are different from traditional 
resource allocations in order to support resource needs, 
professional development and orientation, teacher release 
time, and paraprofessional and clerical assistance. 

12. A flexible physical plant design enhances th.e implementation 
of this type of program but it is not essential. 



Recommendations for the Calgary Board of Education 



Based on data collected in Project ABC, it is recommended to the 
Calgary Board of Education that; 

1. Contingent upon Alberta Education approval, the three Project 
ABC programs be granted exemption from the Carnegie Unit. 

2. Contingent upon Alberta Education approval, opportunity be 
provided for other Calgary Board of Education schools to 
offer Project ABC- type programs which are also granted 
exemption from the Carnegie Unit. 

3. The School-wide Model achievement levels be evaluated for two 
addicional years. 
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4. Consideration be given to exploring different ways of alloca- 
ting resources to Project ABC-type schools. 

5. Consideration be given to the teacher characteristics identi- 
fied in this study as being critical to program success when 
assigning staff to alternative Project ABC-type programs. 

6. Consideration be given to student learning styles and to 
matching them with appropriate program delivery when 
enrolling students in Project ABC-type programs. 

7. Flexible instructional spaces be considered in the construc- 
tion of new schools and the renovation of existing ones. 

8. Project ABC teachers and administrators be formally commended 
for their dedication and commitment in making these programs 
successful and that their successes be celebrated. 



Recommendations for Alberta Education 

Based on data collected in Project ABC, it is recommended to 
Alberta Education that: 

1. Contingent upon Calgary Board of Education approval, the 
three Project ABC programs be granted exemption from the 
Carnegie Unit. 

2. Opportunity be provided for Alberta school jurisdictions to 
offer Project ABC-type programs which are .also granted 
exemption from the Carnegie Unit. 

3. Incentives be provided for school authorities embarking on a 
Project ABC-type program to support model development. 

4. A clearing house for individualized curriculum materials be 
established. 

5. Consideration be given to more frequent administrations of 
Grade 12 Diploma Examinations during the year to accommodate 
the needs of students in continuous progress programs. 

6. A follow-up study be conducted to determine the success of 
Project ABC students in post-secondary programs or work 
environments. 
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Implications 

During the five-year period of Project ABC, it became apparent 
that a project of this magnitude would have far-reaching and long- 
term implications which would extend beyond 1987 and into the 
lives of current and future students, teachers and administrators 
in Alberta. Some of the implications are discussed below. 

PROPOSED ALBERTA SCHOOL ACT 

The proposed Alberta School Act is based on five principles: 
access to quality education; equity; flexibility; responsiveness; 
and accountability. Of particular relevance to Project ABo, and 
other programs which provide an alternative to time-credit, is the 
concept of flexibility. These programs address students' needs 
for flexible time use as well as supporting the philosophies of 
personalized education and advancement based on competency. The 
proposed legislation leaves the door open for any school board to 
offer alternative programs such as those described here. 

EDUCATIONAL POLICY 

The Secondary Education in Alberta Policy Statement which was 
formally relea^^d in 1985 by the Minister of Education and the 
Premier of Alberta set a new direction for Alberta's high 
schools. Within the policy were several principles which related 
directly to the goals of Project ABC. These included the 
foxlowing: 

Principle #1 The secondary school, in coC'^ation with other 
agencies in society, must assiis. each student to 
become a competent, confident and responsible 
ind i V idual . However , the secondary school must 
assume primary responsibility for the intellectual 
development of each student and for fostering the 
desire for lifelong, self-dirt ^.ted learning. 
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Principle #2 The development and implementation of the instruc- 
tional program must take into account the 
following considerations: 



Among the guidelines set for senior high programs in the document 
was one which acknowledged the potential already being explored by 
Project ABC, specifically: 

While the content and objectives of courses are set, the 
secondary school program and administrators should encourage 
teachers to use appropriate teaching strategies and materials 
to accommodate individual learning styles and needs. Oppor- 
tunities for continuous learning, individualized instruction, 
and otner strategies ... should be expanded at both the 
junior and senior high school levels.^ 

By 1987, in a document entitled Proposed Directions for Senior School 
Programs and Graduation Requirements y specific mention was made of 
alternatives to the Carnegie Unit and school boards were invited 
to explore this alternative provided that all students had access 
to at least minimal instructional time to realize course expecta- 
tions 

Project ABC is in the forefront of alternatives to the Carnegie 
Unit. Now that the project has been completed and the results 
have been reported, it may have an impact on Alberta's high 
schools. Alternative use of t-ime in schools and alternative 
delivery, systems have created positive learning environments. 
More schools may want to explore them. 

TEACHING AND LEARNING STYLES 

There are many individuals whose lives have been changed as a 
result of their involvement in Project ABC. After spending up to 
five years on revising their methodologies, trying new approaches, 
being open to change, becoming familiar with different learning 



• the nature and needs of the learner 

» the nature and needs of a changing society 

• the nature of knowledge in each subject area 

• the learning environment^ 
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styles, fostering student independence and changing the tradi- 
tional teaching approach, there are teachers whose teaching styles 
have been permanently altered as a result of teaching in project 
schools. They have often been heard to say, "I could never go 
back to the old style of teaching." Whether they have an option 
remains to be seen, but even in a closed classroom situation they 
may find a lot of their skills transferable and their teaching 
enriched as a result. Further, the leadership skills which many 
have developed as a result of meeting the challenges of Project 
ABC may well encourage them to pursue career paths they might not 
have otherwise. 

Undoubtedly, there has been an impact on students as well. They 
have had their learning style needs addressed in a number of 
innovative ways. Some have experienced success through the provi- 
sion of additional time. Others have been challenged by enrich- 
ment activities they would not have had time for otherwise. Still 
others have been able to concentrate on ar'^as of weakness while 
moving more quickly through areas of strength. Many have learned 
time management skills and have had closer, more satisfying rela- 
tionships with their teachera. 

Administrators met the challenge of finding innovative solutions 
to staff development needs, budget constraints, student tracking 
and record keeping, and school leadership problems. 

ADDITIONAL RESEARCH 

Several areas for further research emerge from Project ABC. The 
substantial documentation resulting from this study includes five 
Formative Evaluation Reports and the Delphi Study, each of which 
is based on significant amounts of quantitative and qualitative 
data. Along with this Sununative Evaluation Report, they form a 
rich source of information for further analysis. 
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Other research which should be conducted includes the continued 
tracking of student achievement at the 30-level in the School-wide 
Model jr two additional years as the Grade 12 program was only 
operational in the final year of the project. In addition, 
Project ABC students should be tracked in their post-secondary or 
career situations to determine the long-term effects of persona- 
lized instruction and non-traditional use of time. Fifty years 
ago, the Eight-Year Study tracked high schi^ol students throughout 
their college years but did not attempt to follow up those gra- 
duates who went immediately into the work force although the need 
to do so was acknowledged. Perhaps this tim such a follow-up 
study could be implemented, supported by foundation grants as was 
the case in the Eight-Year Study. 

Finally, the impact of the D^^oject should be tracked in terms of 
teacher development over the next five years. This study has 
identified the profound effect that Project ABC has had on 
teaching styles but project teachers* future development in terms 
of leadership, risk taking ability, creativity and job 
satisfaction is worth pursuing further. 

CONCLUDING COMMENTS 

Project ABC was a successful adventure in learning. For teachers 
who watched their students turn into independent, self-directed 
learners, for administrators who watched their teachers develop 
unforeseen strengths and skills, and for the project director and 
the project evaluator who watched the three schools address and 
meet the challenges they had set for themselves, the journey was 
worth the effort. 

High school traditions which have linked time and credit since 
early in the century were confronted and overturned. Project ABC 
proved that there are other ways to manage time in high schools 
and other ways to award credit. Satisfaction rose when students 
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had more control over how they spent their time in school. They 
appreciated working at their own pace. Satisfaction rose when 
teachers could address individual student needs as they occurred. 
They appreciated working outside the bounds of a rigid timetable. 
Satisfaction rose when administrators did not have to fail 
students simply because they needed more time. They appreciated 
the improved school climate which resulted from increased coopera- 
tion between staff and students. 

Project ABC is no longer an experiment. It is an alternative 
approach to higli school which acknowledges individual learning 
needs, individual learning rates and individual learning styles. 
What better way to approach the end of the century, but with a new 
vision about how high schools can work. 
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Comments 



STUDENT ACHIEVEMENT 

To respond to the question What change" occurred in the achievement 
of project students during the course of the project, three courses, 
Typing 30, Accounting 30 and Law 30, were subjected to univariate 
analysis of variance with year as a factor to determine change 
over time within Ihe project school. The program employed was the 
SPSS ONEWAY with post hoc testing. 

Highlights of the statistical analysis indicate that Accounting 30 
was the only course to show, any significant change over time. An 
F (3, 41) = 3.52, p = 0.02 was identified in the analysis of 
variance for Accounting 30 and the Scheffe procedure (post hoc 
ONEWW contrast) yielded a significant difference between the 
grades in i983-1984 and 1985-1986. There was a significant 
decrease in the mean from 72.4 to 46.7. The mean scores were 
significantly different at the ,05 level. The r^ean rose again in 
1986-1987, but not significantly. 

To respond to the question How did achievement levels of project 
students compare with those of non-project students within the system and 
within the province, the variables or courses were then subjected to 
univariate analysis of variance with student population (school, 
city and province) as a factor to determine significant differ- 
ences between groups throughout Project ABC. 

The program employed was the SPSS-X ONEWAY with post hoc testing. 
Caution should be taken in placing too much emphasis on these 
statistical data. Due to the large difference in the size of the 
student populatic " being contrasted, the assumption of homoge- 
neity of variance cannot be met. Therefore, the significantly 
different values may be inflated. Highlights of the statistical 
analysis indicate that students* grades in Typing 30 in 193^i-1985 
were significantly lower than the city and the province, students* 
grades in Law 30 in 1984-1985 were significantly higher than those 
of the controls, and students* grades in Accounting 30 in 1985- 
19?6 were significantly lower than those of the controls. 

An F (2, 3793) = 4.92, p = 0.01, was identified in the analysis of 
variance for Typing 30 in 1984-1985 and the Scheffe procedure 
yielded significant difference between achievement levels in the 
school and in the control groups. The mean scores were signifi- 
cantly different at the .05 level. 

An F (2, 2938) = 3.83, p = 0.02, was identified in the a^ilysis of 
variance for Law 30 in 1985-19SD and the Scheffe procedure yielded 
a significant difference between achievement levels in the school. 
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and in the control groups. The mean scores were significantly 
different at the .05 level. 

An F (2, 2937) = 11.06, p = <.001, was identified in the analysis 
of variance for Accounting 30 in 1935-1986 and the Scheffe proce- 
dure yielded a significant difference between achievement levels 
in the school and in the control groups. The mean scores were 
significantly different at the .05 level. 



TIME REMOVED AS A CREDIT REQUIREMENT 

The variables stop mechanism y learning rate compatible with ability, 
and flexible entrance to the next course level extracted from the 
student questionnaire were subjected to univariate analysis of 
variance with year as a factor to determine change over time. The 
program employed was the SPSS ONEWAY with post hoc testing. 

Highlights of the statistical analysis indicate that with a 
project success rate set at a mean score of 3.5, students 
perceived successful goal attainment in terms of the presence of a 
stop mechanism and the provision of flexible entrance to the next 
course level. They did not, however, perceive a successful level 
of attainment in terms of providing for compatibility between 
learning rate und ability. Although there was some growth in this 
area over the course of the project, it did not reach satisfactory 
levels. 

Descriptive statistics for teacher and administrator perceptions 
of these variables, extracted from their respectives question- 
naires were also included, although no analysis of variance was 
conducted due to small sample size. 

Interview data referred to in the main text is reported in the 
five Formative Evaluation Reports. 



COMPETENCY THE BASIS FOR AWARDING CREDIT 

The variables test use at the unit level y demonstrated competency at the 
unit level before proceeding and advancement based on competencyy not 
time on the student questionnaire were also subjected to a univa- 
riant analysis of variance w^'th year as a factor to determine 
change over time. The program employed was the SPSS ONEWAY with 
post hue testing. 

Highlights of the statistical analysis indicate that with a 
project success rate set at a mean score of 3.5, students 
perceived successful goal attainment in terms of test use at the unit 
level and the provision of the opportunity for advancement based on 
competency to the next course level. They did not perceive a 
successful level of attainment in terms of requiring students to 
demonstrate competency before proceeding to the next unit. However, 
significant growth was achieved in this area. An F (3, lJ71) = 

18 3 
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3.48, p = 0.02 was identified in the analysis of variance and th^ 
Scheffe procedure (post hoc OMEWAY contrast) yielded significant 
differences between 1984 and 1985. There was a significant 
increase in the mean from 1984 to 1985. While the variable then 
declined in 19B6, it rose even further in 1987 to a mean of 3.2. 

Descriptive statistics for *;eacher and administrator perceptions 
of these variables are also included although no analyvSis of 
variance was conducted due to small sample size. 

Interview data referred to in the main text is reported in the 
five Formative Evaluation Reports. 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVIiMENT 
DEPARTMENT-BASED MODEL 



1984-1987 


COURSE 




1984 


1985 


1986 


1987 


1 . TYPING 30 


Mean 


63.2 


56.7 


62.8 






s.d. 


12.9 


16.5 


12*3 






N 


18 


15 


16 




2. ACCOUNTING 30** 


Mean 


72.4 


59.0 


46.7 


61 .4 




s.d. 


10.0 


23.6 


27.4 


20.0 




N 


17 


9 


9 


7 


3. LAW 30 


Mean 


60.0 


73.5 


65.3 


70.2 




s.d. 


18.1 


M.8 


1K6 


12.3 




N 


22 


16 


15 


5 



* student sairple less than 5; therefore, analysis is not valid. 

An F (3, 41) = 3.5^, p = 0.02 with significant difference 
between 1984 and 1986. 
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ANALYSIS OF VARIANCE FOR STUDENT ACHIEVEMENT 
DEPARTMENT-BASED MODEL 

1984-1987 



VARIABLE 



1. TYPING 30 



SOURCE 



Between Groups 
Within Groups 
Total 



SS df 



MS 



486.92 
8984.83 
9471 .75 



3 

48 
51 



162.31 
187.18 



F p 



0.87 0.46 



2. ACCOUNTING 30 



Between Groups 
Within Groups 
Total 



4020.24 
14457.60 
18477.83 



3 1340.08 
38 380.46 
41 



3.52 0.02 



3. LAW 30 



Between Groups 
Wilhin Groups 
Total 



1776.29 
12686.69 
14462.98 



3 592.10 
54 234.94 

57 



2.52 0.07 



86 



- 163 - 



DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, TYPING 30, 
DEPARTMENT-BASED MODEL, 





CALGARY BOARD OF 


EDUrATTOM flMH 


PPnU TMPC 


OF ALBERTA 






1984-1 Qft7 










TYPING 30 


1984 


1985* 


1986 


1987 


1. 


Department-based Mean 


yjj • ^ 




62.8 






Model s,d. 


12.9 


16.5 


12.3 






N 


18 


15 


16 




2, 


Calgary Board Mean 


66.1 


66.0 


66.0 


65.7 




of Education s,d. 


14.2 


14.6 


14.1 


13.6 




N 


514 


467 


371 


363 


J • 


Province of Mean 


67.4 


66.9 


67.2 


67.9 




Alberta s,d. 


13.4 


13.5 


13.8 


13.7 




N 


3596 


3312 


3001 


2695 




F (2, 3793) = 4,92, p 


= O.Cl. Significant difference 


bet\Nieen 




Model and both control 


group5; in I985 








Student sample less than 5; therefore 


, analysi 


s is not 


valid. 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, ACCOUNTING 30, 

DEPARTMENT-BASED MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 

1984-1987 



ACCOUNTING 30 1984 1985 1986* 1987 



1. Department-based Mean 72.4 59.0 46.7 61.4 

Model s.<J. 10.0 23.6 27.4 20.0 

N 17 9 9 7 



2. Calgary Board Mean 69.1 70,4 68.7 70.5 

of Education s.d. 16.5 15.9 17.5 16.6 

N 624 555 498 433 



3. Province of Mean 70.5 70.5 70.0 71.1 

Alberta s.d. 15.2 15.1 15.4 15.5 

N 2847 2697 2431 2255 



'* F (2, 2937) = 11.06, p = <.00i. Significant difference between 
Model and botn control groups in 1986. 



ERLC 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, LAW 30, 
DEPARTMENT-BASED MODEf-, 



CALGARY BOARD OF 


EDUCATION AND 


PROVINCE 


OF ALBERTA 






1984-1987 








LAW 30 


1984 


1985* 


1986 


1987 


1 . Department-base^ Mean 


60.0 


73.5 


65.3 


70.2 


Model s.d. 


18.1 


14.8 


11.6 


12.3 


N 


22 


16 


15 


5 


2. Calgary Board Mean 


60.9 


62.6 


59.8 


64.0 


of Education s.d. 


16.9 


15.7 


15.7 


15.8 


N 


372 


323 


352 


298 


3. Province of Mean 


61 .9 


62.2 


61.9 


62.^ 


Alberta s.d. 


14.5 


i3.8 


14.2 


14.2 


N 


2739 


2721 


2572 


2828 



* F (2, 2938) = 3.83, P = 0.02. Significant difference between 
Model and both control groups in 1985. 
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PROJECT ABC STUDENT ACHIEVEMENT 
ANALYSIS OF VARIANCE OF DEPARTMENT-BASED MODEL, 
SYSTEM AND PROVINCE FINAL GRADES 

19S7 



VARIABLE SOURCE SS 



1. 


TYPING 30 


Between Groups 
Within Groups 
Total 


1907.84 
570784.06 
572691 .90 


2 

3058 
3060 


953.92 
186.65 


5.11 


0.01 


2. 


ACCOUNTING 30 


Between Groups 


756.15 


2 


378.08 










Within Groups 


664242.28 


2692 


246.75 


1.53 


0.22 






Total 


664998.44 


2694 






3. 


LAW 30 


Between Groups 
Within Groups 
Total 


580.65 
645526.72 
646107.38 


2 

3128 
3130 


290.33 
206.37 


1.41 


0.25 



o 19 0 
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PROJECT ABC STUDENT ACHIEVEMENT 
ANALYSIS OF VARIANCE OF DEPARTMENT-BASED MODEL, 
SYSTEM AND PROVINCE FINAL GRADES 

1986 



VARIABLE 



SOURCE 



ss 



df 



MS 



K TYPING 30 



Between Groups 
Within Groups 
Total 



767,68 
643542 J 7 
644309,85 



2 383,84 
3385 190,12 
3387 



2,02 0,13 



2, ACCOUNTING 30 



3, LAW 30 



Between Groups 
Within Groups 
Total 



5551 ,94 
736836,74 
742388,68 



2 2775,97 
2935 251,05 
2937 



Between Groups 
Within Groups 
Total 



1586,01 
607790,00 
609376,01 



2 

2936 
2938 



793,00 
207,01 



11,06 <,001 



3,83 0,02 
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PROJECT ABC STUDENT ACHIEVEMENT 
ANALYSIS OF VARIANCE DEPARTMENT-BASED MODEL, 
SYSTEM AND PROVINCE FINAL GRADES 

1985 



VARIABLE SOURCE SS df MS 



1, TYPING 30 Between Groups 1831,12 2 915,56 

Within Groups 705031 ,80 3791 185,93 4,92 0,01 
Total 706862,92 3793 



2, ACCOUNTING 30 Between Groups 1188,28 2 594,14 

Within Groups 755527,67 3258 231 ,90 2,56 0,08 
Total 756715,95 3260 



LAW 30 Between Groups 2072,99 2 1036,49 

Within Groups 596964,31 3057 195,28 5,31 0,0) 
•Total 599037,29 3059 



192 
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PROJECT ABC STUDENT ACHIEVEMENT 
ANALYSIS OF VARIANCE OF DEPARTMENT-BASED MODEL, 
SYSTEM AND PROVINCE FINAL GRADES 

1984 



VARIABLE 



1. TYPING 30 



SOURCE 



SS 



df 



MS 



Between Groups 
Within Groups 
Total 



1087.21 
749368 .03 
750455.24 



2 543.61 
4125 181.67 
4127 



F p 



3.00 0.05 



2. ACCOUNTING 30 



Between Groups 
Within Groups 
Total 



1068.49 
8^9017.91 
830086.40 



2 534.24 
3485 237.88 
3487 



2.25 0.11 



3. LAW 30 



Between Groups 
Within Groups 
Total 



399.37 
685517.27 
685916.64 



2 199.69 
3130 219.02 
3132 



0.91 0.40 
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PROJECT ABC: DEPARTMENT-BASED MODEL, 
DESCRIPTIVE STATISTICS FOR THE kEMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1984-1987 
STUDENTS 





1984 


1985 


1986 


1987 




Mean 


Mean 


Mean 




VARIABLE 


s.d. 


s.d. 


s.d. 


S.d. 




N 


N 


N 


N 


1. STOP MECHANISM 


3.7 


3.6 


3.5 


4.0 




0.9 


1.0 


0.9 


0.0 




217 


117 


118 


23 


2. LEARNING RATE COMPATIBLE 


2.6 


2.5 


2.7 


2.9 


WITH ABILITY 


1.3 


1.4 


1.2 


1.1 




218 


119 


117 


23 


3. FLEXIBLE ENTRANCE 


3.9 


4.0 


3.8 


4.0 


TO NEXT COURSE LEVEL 


1 .4 


1.2 


1.3 


1.0 




213 


116 


117 


23 
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PROJECT ABC: DEPARTMENT- BASED MODEL, 
ANALYSIS OF VARIANCE FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1984-198? 
STUDENTS 



VARIABLE 



SOURCE 



ss 



df 



MS 



1 . STOP MECHANISM 



Between Groups 3.84 3 ] .28 

Within Groups 415.71 471 0.88 

Total 419.55 474 



1.45 0.23 



2. LEARNING RATE Between Groups 3.24 3 1.08 

COMPATIBLE Within Groups 750.34 473 1.59 0.68 0 56 

WITH ABILITY Total 753.58 476 



3. FLEXIBLE ENTRANCE Between Groups 2.74 3 0.91 

TO NEXT COURSE Within Groups 791.93 :55 1.70 0.54 0.66 

LEVEL Total 794.67 468 
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Stop Mechanism 




W O 



0) 



0) 



13 C 

00 a. 



1984 1985 1986 1987 

Learning Rate Compatible with Ability 

5- 




1984 1985 1986 1987 



iERiC 



W O 



0) 



0) 



Flexible Entrance to Next Course Level 




1984 1985 1986 1987 
iW^ 
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t'ROJECT ABC: DEPARTMENT-BASED MODEL, 
DESCRIPTIVE STATISTICS FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1984-1987 
TEACHERS 



1984 1985 1986 1987 

Mean Mean Mean Mean 

VARIABLE s.d. s.d. s.d. s.d. 

N N N N 



1. STOP MECHANISM 4.7 4.3 3.8 4.4 

.5 .8 .4 .5 

6 6 5 5 



2. LEARNING RATE CWPATIBLE 3.8 4.0 3.8 4.6 

WITH ABILITY j 4 5 

6 6 5 5 



3. FLEXIBLE ENTRANCE 4.7 4.7 3.4 4.2 

TO NEXT COURSE LEVEL 5 5 .4 

6 6 5 5 



ERIC 
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PROJECT ABC: DEPARTMENT-BASED MODEL, 
DESCRIPTIVE STATISTICS FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1984-1987 
ADMINISTRATORS 





1984 


1985 


1986 


1987 




Mean 


Mean 


Mean 


Mean 


VARIABLE % 


s.d. 


s.d. 


s.d. 


s.d. 




N 


N 


N 


N 


1. STOP MECHANISM 


3.7 


3.8 


3.8 


3.8 




.5 


.4 


.4 


.4 




6 


6 


6 


4 


2. LEARNING RATE COMPATIBLE 


3.5 


4.0 


4.0 


3.8 


WITH ABILITY 


.5 


.6 


.8 


.4 




6 


6 


6 


4 



3. FLEXIBLE ENTRANCE 3.3 4.0 3.8 4.0 

TO NEXT COURSE LEVEL g 8 9 0 

6 6 6 4 
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PROJECT ABC: DEPARTMENT-BASED MODEL, 
. DESCRIPTIVE STATISTICS FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1984-1987 
STUDENTS 



19811 1985 1986 198? 

Mean Mean Mean Mean 

VARIABLE s.d. s.d. s.d. s.d. 

N N N N 



1. TEST USE AT 3.9 3.5 3.9 4 5 
UNIT LEVEL , ^ 

'•6 1-6 1.4 1.0 

214 120 115 2? 



2. DEMONSTRATE COMPETENCY 2.5 3.I 2.6 3 2 

BEFORE PROCEED I NG-* 

1-7 1.7 1.8 1.6 



214 119 116 23 



3. ADVANCEMENT BASED 4.4 4.5 43 45 

ON COMPETENCY 

'•2 1.0 1.2 0.8 

218 120 115 23 



^J?' ^'^^K^ P = Significant difference between 

1984 and I985. 



ERIC 
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PROJECT ABC: DEPARTMENT-BASED MODEL, 
ANALYSIS OF VARIANCE FOR COMPETENCY 
BECOMING THC BASIS FOR AWARDING CREDIT 

1984-1987 
STUDENTS 



VARIABLE SOURCE SS df MS F p 



1. TEST USE Between Groups 18.01 3 6.00 

AT UNiT LEVEL Within Groups 1090.39 468 2.33 2.58 0.05 

Total 1108.40 471 



2. DEMONSTRATE Between Groups 29.70 3 9.90 

COMPETENCY BEFORE Within Groups 1333.58 468 2.85 3.48 0.06 

PROCEEDING Total 1363.29 471 



3. ADVANCEMENT Between Groups 2.12 3 0.71 

BASED ON Within Groups 573.06 472 1.21 0.58 0.63 

COMPETENCY Tota 1 575 . 1 8 475 
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Test Use at Unit Level 




I — ^ — . — I 

1984 1985 1986 1987 



00 a. 



Demonsirate Competency before Proceeding 

5' 




1984 1985 1986 1987 



Advancement Based on Connpetency 




1984 1985 1986 1987 
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PROJECT ABC: DEPARTMENT-BASED MODEL, 
DESCRIPTIVE STATISTICS FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1984-1987 
TEACHERS 







19811 


1985 


1986 


1987 






Mean 


Mean 


Mean 






VARIABLE 


s.d. 


s.d. 


s.d. 


s.d. 






N 


N 


N 


N 


1. 


TEST USE AT 


4.8 


3.7 


4.2 


4.4 




UNIT LEVEL 


.4 


1.3 


.4 


.5 






6 


6 


5 


5 


2. 


DEMONSTRATE COMPETENCY 


4.2 


3.7 


4.0 


4.0 




BEFORE PROCEEDING 


.4 


.5 


1.0 


.0 






6 


6 


5 


5 


3. 


ADVANCEMENT BASED 


4.7 


4.8 


4.4 


4.8 




ON COMPETENCY 


.5 


*4 


.8 


.4 






6 


6 


5 


5 
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PR0JE:T ABC: DEPARTMENT-BASED MODEL, 
DESCRIPTIVE STATISTICS FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1984-1987 
ADMINISTRATORS 



VARIABLE 



1984 


1985 


1986 


1987 


Mean 


Mean 


Mean 


Mean 


s.d. 


s.d. 


s.d. 


s.d. 


N 


N 


N 


N 



TEST USE AT 4.8 5.0 4.3 4.8 

UNIT LEVEL Ann. 

.4 .0 .8 .4 

6 6 6 4 



2. DEMONSTRATE COMPETENCY 4.2 4.8 4.3 4.0 

BEFORE PROCEEDING a a a \ 

.4 .4 .8 .0 

6 6 6 4 



3. ADVANCEMENT BASED 4.0 4.3 4.8 4.8 

ON COMPETENCY ^ o . * 

•o .8 .4 .4 

6 6 6 4 
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STUDENT ACHIEVEMENT 

To respond to the question What changes occurred in the achievement 
of project students during the course of the project, eight 
courses: English 30, English 33, Social Studies 30, Math 30, Math 
33, Biology 30, Chemistry 30 and Physics 30, were subjected to a 
univariate analysis of variance with year as a factor to determine 
change in students* grades over time with the project school. The 
program employed was the SPSS ONEWAY with post hoc testing. 

Highlights of the statistical analysis indicate that Chemistry 30 
was the only course to show any significant change over time. An 
F (2, 114) = 4.55, p = 0,01 was identified in the analysis of 
variance for Chemistry 30 and the Scheffe procedure (post hoc 
ONEWAY contrast) yielded a significant difference between the 
grades in 1985-1986 and 1986-1987 . There was a significant 
increase in the mean from Year 4 to Year 5 of 63.7 to 74.1. The 
mean grades were significantly different at the ,05 level. 

To respond to the que^lion How did achievement levels of project 
students compare with those of non-project students within the system and 
within the province, the eight courses were subjected to univariate 
analysis of variance with student population (school, city and 
province) as a factor to determine signficant differences between 
groups throughout Project ABC. The program employed was the 
SPSS-X ONEWAY with post hoc testing. 

Highlights of the statistical analysis indicate that students* 
grades in Chemistry in 1986-1987 were significantly higher than 
the city and the province. An F (2, 18467) = 4,50, p = 0.01 was 
identified in the analysis of variance for Chemistry 30 in Year 5 
and the Scheffe procedure yielded a significant difference between 
achievement levels in the school and in the control groups. The 
mean scores were significantly different at the .05 level. 
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TIME REMOVED AS A CREDIT REQUIREMENT 

The variables stop mechanism, learning rate compatible mth ability, 
and flexible entrance to the next course level extracted from the 
student questionnaire were subjected to a univariate analysis of 
variance with year as a factor to determine change over time. The 
program employed was the SPSS ONEWAY with post hoc testing. 

Highlights of the statistical analysis indicate that with a 
project success rate set at a mean score of 3.5, .students 
perceived successful goal attainment in terms of the development 
of a stop mechanism. They did not perceive a successful level of 
attainment in terms of the program providing compatibility between 
learning rate and ability or in terms of providing flexible entrance to 
the next course level and, in fact, the availability of the latter 
two criteria was perceived to decline significantly over time. 

Perceptions about tb-^ vision of a stop mechanism grew signifi- 
cantly during the course of the project with an F (3, 505) = 4.24, 
p = 0.01. The Scheffe procedure indicated significant differences 
between 1984 and 1985. There was a significant increase in the 
means between 1984 and 1985 and while declining in later years 
from that high, remained in evidence to a satisfactory extent 
until the end of the project. 

Students did not perceive the program providing for compatibility 
between learning rate and ability and, in fact, this component 
declined significantly over time with an F (3, 502) = 8.43, 
p = <.001. The Scheffe procedure indicated significant differ- 
ences between 1984 and 1985, 1984 and 1986, and 1984 and 1987. 
There was a significant decrease in the mean every year compared 
to 1984. 

Students also did not perceive the program providing flexible 
entrance to the next course level and this variable declined 
significantly over time with an F (3, 500) = 26.53, p = <.001. 
The Scheffe procedure indicated very significant differences 
between 1984 and 1985, 1984 and 1986, and 1984 and 1987. There 
was a significant decrease in the mean every year compared with 
1984. 

Descriptive statistics for teacher and administrator perceptions 
of these variables , extracted from their respective question- 
naires, are also included although no analysis of variance was 
conducted due to small sample size. 

Interview data referred to in the main text is reported in the 
five Formative Evaluation Reports. 
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COMPETENCY THE BASIS FOR AWARDING CREDIT 

The variables test use at the unit level, demonstrated competency at the 
unit level before proceeding and advancement based on competency, not 
time on the student questionnaire were also subjected to a univa- 
riate analysis of variance with year as a factor to determine 
change over time. The program employed was the SPSS ONEWAY with 
post hoc testing. 

Highlights of the statistical analysis indicate that with a 
project success rate set at a mean score of 3.5, students 
perceived successful goal attainment in terms of test use at the unit 
level. They did not, however, perceive a successful level of 
attainment in terms of requiring demonstrated competency before 
proceeding to the next unit or in providing students with the oppor- 
tunity for advancement based on competency to the next course 
level . 

Student perceptions regarding the frequency of test use at the unit 
level increased significantly in 1985, with an F (3, 505) = 5.39, 
p = <.00U The Scheffe procedure indicated significant differ- 
ences between 1984 and 1985. There was a significant increase in 
the mean from 1984 to 1985. 

Students' perception regarding the requirement that students 
demonstrate competency before proceeding to the next unit remained at 
unsatisfactory levels throughout the project and, in fact, 
declined over time although no significant changes occurred. 

Students' perception regarding advancement based on competency 
declined significantly during the course of the project. The 
variable was very significant with an F (3, 495) = 26.71, 
p = <.001. The Scheffe procedure indicated significant differ- 
ences between 1984 and 1985, 1984 and 1986, and 1984 and 1987. 
There was a significant decrease in the mean in eve.7 other year 
compared to 1984. This pattern is similar to that found for the 
criteria related to time removal as a credit requirement, namely 
learning rate compatibility with ability and flexible entrance to the next 
course level. The similarity of findings regarding these closely- 
linked concepts provides support for the validity of statistical 
approaches employed. 

Descriptive statistics for teacher and administrator perceptions 
of these variables are also included although no analysis of 
variance was conducted due to small sample size. 

Interview data referred to in the main text are reported in the 
five Formative Evaluation Reports. 



ERLC 



'207 



- 184 - 



DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT 
PARALLEL CORE PROGRAM MODEL 

1985-1987 



COURSE 1985 1986 1987 



1. ENGLISH 30 Mean 65.7 66.2 68.3 

s.d. 10.4 11.0 11.3 

N 41 40 58 



2. ENGLISH 33 Mean 63.2 64.1 64.0 

s.d. 6.2 7.2 8.3 

N 10 12 8 



3. SOCIAL STUDIES 30 Mean 66.7 70.3 67.4 

s.d. 11.5 10.8 13.3 

N 41 39 57 



4, MATH 30 Mean 66*3 65.9 70.8 

s.d. 16.1 17.6 15.2 

N 40 38 51 



5. MATH 33 Mean 66.1 59.7 58.0 

S.d. 7.8 16.1 12.1 

N 14 23 27 



6. BIOLOGY 30 Mean 66.6 68.0 66.3 

S.d. 15.2 14.6 15.9 

N 34 31 39 



1. CHEMISTRY 30* Mean 70.8 63.7 74.1 

S.d. 15.9 17.8 12.4 

N 37 36 42 



8. PHYSICS 30 Mean 70.5 71.2 69.0 

S.d, 16.4 12.9 14.2 

N 31 23 27 



* F (2, 114) = 4.55, p = 0.01. Significant difference between 
1986 and 1987. 
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ANALYSIS OF VARIANCE FOR STUDENT ACHIEVEMENT 
PARALLEL CORE PROGRAM MODEL 

1985-1987 



VARIABLE 



ENGLISH 30 



2. ENGLISH 33 



SOURCE 



Between Groups 
Within Groups 
Total 



Between Groups 
Within Groups 
Total 



SS df 



MS 



191.41 
16259.87 
16451.28 



2 

136 
138 



4.85 
1398.52 
1403.37 



2 

27 
29 



95.71 
119.56 



2.43 
51.80 



3. SOCIAL STUDIES 30 Between Groups 291.17 2 145.59 

Within Groups 19647.82 134 146.63 
Total 19938.99 136 



0.80 0.45 



0.05 0.95 



1.00 0.37 



4. MATH 30 



5. MATH 33 



6. BIOLOGr 30 



Between Groups 
Within Groups 
Total 



691.35 2 345.68 
53158.61 126 263.16 
33849.97 12a 



Between Groups 
Within Groups 
Total 



53.99 
23693.05 
23747.04 



2 

101 
103 



26.99 
234.58 



1.31 0.27 



Between Groups 617.20 2 308.60 

Within Groups 10273.80 61 168.42 1.83 0.17 

Total 10891.00 63 



0.12 0.89 



7. CHEMISTRY 30 



Between Groups 
Within Groups 
Total 



2155.82 
26527.18 
28682.99 



2 

112 
114 



1077.91 
236.85 



4.55 0.01 



8. PHYSICS 30 



Between Groups 
Within Groups 
Total 



71.97 
16938.26 
17010.22 



2 

78 
80 



35.98 

217.16 0.17 0.85 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, ENGLISH 30, 
PARALLEL CORE PROGRAM MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 

1985-1987 



ENGLISH 30 



1985 



1986 



1987 



1. ParaNel Core 
Program Model 



Mean 
s.d. 
N 



65.7 
10.4 
41 



66.2 
11.0 
40 



68.3 
11 .3 
58 



2. Calgary Board 
of Education 



Mean 
s.d. 
N 



63.1 
11.1 

4622 



63.5 
11.2 
4473 



64.9 
11.1 
4571 



3. Province of 
Alberta 



Mean 
s.d. 
N 



63.8 
10.5 
20612 



64.2 
10.6 
21408 



65.0 
11 .0 

22294 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, 
SOCIAL STUDIES 30, PARALLEL CORE PROGRAM MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 

1985-1987 



SXIAL STUDIES 30 1985 1986 1987 



1. Parallel Core Mean. 66.7 70.3 67.4 

Program Model s.d. 11.5 10.8 13.3 

N 41 39 57 



2. Calgary Board Mean 65.5 66.9 65.3 

of Education s.d. 12.0 12.3 12.4 

N 3874 3553 3643 



3. Province of Mean 64.2 66.1 64.8 

Alberta s.d. 12.0 12.1 12.6 

N 18699 18855 19563 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, MATH 30, 
PARALLEL CORE PROGRAM MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 

1985-1987 



MATH 30 1985 1986 1987 



1. Parallel Core Mean 66.3 65.9 70,8 

Program Mo<Je! s.d. 16.1 17.6 15.2 

N 40 38 51 



2. Calgary Board Mean 63.4 63.6 67.7 

of Education s.d. 15.1 15,5 15,7 

N 4197 3788 3967 



3. Province of Mean 64.5 65 J 68.3 

Alberta s,<J. 15.0 15,5 15,7 

N 17094 17470 22453 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, MATH 33, 
PARALLEL CORE PROGRAM MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 

1985-1987 



MATH 33 



1985 



1986 



1987* 



1 . Para I lel Core 
Program Model 



2. Calgary Board 
of Education 



Province of 
Alberta 



Mean 
s.d. 
N 



Mean 
s.d. 
N 



Mean 
s.d. 
N 



66.1 
7.8 
14 



57.7 
13.3 
1836 



58.2 
12.9 
7625 



59.7 
16.1 
23 



56.1 
13.9 
1916 



57.9 
13.3 

7748 



58.0 
12.1 
27 



56.7 
13.4 
2019 



58.3 
13.3 

8465 



* F (2, 18467) = 4.50, p = 0.01. Significant difference between' 
the Model and both control groups in 1987. 
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DESCRIPTIVE STATIoTICS FOR 3TUDENT ACHIEVEMENT, BIOLOGY 30, 
PARALLEL CORE PROGRAM MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 

1985-1987 



BIOLOGY 30 



1. Parallel Core Mean 
Program Model s.d. 

N 



2, Calgary Board Mean 
of Education s.d. 

N 



1985 



66.6 
15.2 
34 



64. <i 
14.1 
3254 



1986 



68.0 
14.6 
31 



66.0 
14.3 

3254 



1987 



66.3 
15.9 
39 



65.6 
14.9 
3581 



3. Province of 
Alberta 



Mean 
s.d. 
N 



65.9 
13.7 
14929 



66.4 
13.9 
16647 



66.0 
14.8 
17844 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, CHEMISTRY 30, 
PARALLEL CORE PROGRAM MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 

1985-1987 



CHEMISTRY 30 



1985 



1986 



1987* 



1 . Para I lei Core Mean 
Program Model s.d, 
N 



70.8 
15.9 
37 



63.7 
;/.8 
36 



74.1 
12.4 
42 



2. Calgary Board 
oi Education 



Mean 
s.d. 
N 



65.7 
15.2 
3244 



65.5 
15.2 
2934 



68.4 
14.9 
2955 



3. Province of Mean 
Alberta s.d. 

N 



65.6 
14.6 
14266 



65.4 
14.8 
14747 



68.0 
14.7 
15471 



^ F (2, 18^167) = 4.50, p = 0 01. Significant difference between 
Model and both control groups in 1987. 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, PHYSICS 30, 
PARALLEL CORE PROGRAM MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 

1985-1987 



PHYSICS 30 1985 1986 1987 



1. Parallel Core Mean 70.5 71.2 68.9 

Program Model s.d. 16.4 12.9 K.2 

N 31 23 27 



2. Calgary Board Mean 66.5 67.1 68.2 

of Education s.d. 14.2 14.6 14,8 

N 1897 1671 1612 



3. Province of Mean 66.6 67.3 67.8 

Alberta s.d. 13.8 14.2 14.5 

N 7956 7946 3181 
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PROJECT ABC STUDENT ACHIEVEMENT 
ANALYSIS OF VARIANCE OF PARALLEL CORE PROGRAM MODEL, 
SYSTEM AND PROVINCE FINAL GRADES 

1987 





VARIABLE 


SOURCE 


ss 


df 


MS 


F 


P 




ENGLISH 30 


Within Groups 
Total 


fin 

3273041.13 
3273684.73 


o 

26920 
26922 


121.58 


2.65 


0.07 


2. 


SOCIAL STUDIES 30 


Rptwppn nrniin^ 

Within Groups 
Total 


Q1 ^ 1 ^ 
3659410.94 
3660325.10 


o 

4. 

23260 
23262 


j|C7 AO 

157.33 


2.91 


0.06 


3, 


MATH 30 

1 I<1 III «r W 


Rp^uppn r^r'niinc 

Within Groups 
Total 


5546514.91 
5548154.40 


■J 

2:<:450 
22452 


819.75 
247.06 


3.32 


0.04» 


4. 


MATH 33 


Between Groups 
Within Groups 
Total 


4091.99 
1852652.75 
1856744.74 


2 

10508 
10510 


2045.99 
176.31 


11.61 


<.001*» 


5. 


BIOLOGY 30 


Between Groups 
Within Groups 
Total 


512.52 
4695273.65 
4695786.17 


2 

21461 
21463 


256.26 
218.78 


1 .17 


0.31 


6. 


CHEMISTRY 30 


Between Groups 
Within Groups 
Total 


1948,56 
4001054.35 
4003002.91 


2 

18465 
18467 


974.28 
216.68 


4.50 


0.01 


7. 


PHYSICS 30 


Between Groups 
Within Groups 
T ^al 


234.36 
2070961.38 
2071195.74 


2 

9817 
9819 


117.18 
210.96 


0.56 


0.57 



* Post hoc tests indicated differences were not significant. 
^ Significant difference occurred between control groups only. 
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PROJECT ABC STUDENT ACHIEVEMENT 
ANALYSIS OF VARIANCE OF PARALLEL CORE PROGRAM MODEL, 
SYSTEM AND PROVINCi: FINAL GRADES 

1986 



VARIABLE SOURCE SS df MS 



1. ENGLISH 30 Between Groups 2139.15 2 1069.57 

Within Grcups 2989661.24 25918 115.35 9.27 <.001» 
Tota I 299 1 800 . 39 25920 



2. SOCIAL STUDIES 3C Between Groups 2189.80 2 1094.90 

Within Groups 3293363.13 22444 146,74 7.46 <.001» 
Total 3295552.93 22446 



3. MATH 30 Between vroups 6747.14 2 3373.57 

Within Groups 5092276.98 21293 239.15 14.11 <.001» 
Total 5099024.12 21295 



4. "ATH 33 Betwe'in Groups 4982.06 2 2491.03 

Within Groups 1754501. 9584 181.18 13.75 <.001» 
Total 5759483.33 9686 



5. BlOLOGV 30 Between Groups 480.74 2 240.37 

Within Groups 3901142.55 19929 195.75 1.23 0.29 
Total 3901623.28 19931 



6. CHEMISTRY 30 Between Groups 117.88 2 58.94 

Within Groups 3918035.31 17714 221 .18 0.27 0.77 
Total 3918153.19 17716 



7. PHYSICS 30 Between Groups 438.50 2 219.23 

Within Groups 1956949.88 9637 203.07 1.08 0.34 
Total 1957388.38 9639 



Significant differences occurred between control groups only. 
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PROJECT ABC STUDENT ACHIEVEMENT 
ANALYSIS OF VARIANCE OF PARALLEL CORE PROGRAM MODEL, 
SYSTEM AND PROVINCE FINAL GRADES 

1985 



VARIABLE 



SOURCE 



SS 



df 



MS 



1. ENGLISH 30 



Between Groups 2136.51 2 1068.26 

Within Groups 2849919.39 25272 112.77 9.47 <.001* 

Total 2852055.90 25274 



2. SOCIAL STUDIES 30 Between Groups 5346.92 2 2673.46 

Within Groups 3269422.36 22611 144.59 18.49 <.001* 
Total 3274769.28 22613 



3. MATH 30 



Between Groups 4438.54 2 2219.27 
Within Groups 4815873.65 21328 225.80 
Total 4820312.19 21330 



9.83 <.001* 



4. MATH 33 



Between Groups 1299.94 2 649.97 
Within Groups 1599612.91 9472 168.88 
Total 1600912.85 9474 



3.85 0.02** 



5. BIOLOGY 30 



6. CHEMISTRY 30 



Between Groups 2624.58 2 1312.29 
Within Groups 3452151.93 18214 189.53 
Total 3454776.51 18216 



6.92 <.001* 



Between Groups 1000.21 2 500.11 
Within Groups 3801134.09 17544 216.66 
Total 3802134.30 17546 



2.31 0.10 



7. PHYSICS 30 



Between Groups 470.19 2 235.10 

Withir. Groups 1916526.38 9881 193.96 
Total 1916996.57 9883 



1.21 0.30 



* Significant differences occurred between control groups only, 
Post hoc tests indicated differences were not significant. 
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PROJECT ABC: PARALLEL CORE PROGRAM MODEL, 
DESCRIPTIVE STATISTICS FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1984-1987 



STUDENTS 







1984 


1985 


1986 


1987 




VARIABLE 


Mean 
s.d. 


Mean 
s.d. 


Mean 
s.d. 


Mean 
s.d. 






N 


N 


N 


N 


1. 


STOP MECHANISM* 


3.6 


4.0 


3.9 


3.9 






1.0 


0.9 


0.7 


0.6 






142 


192 


115 


57 


2. 


LEARNING RATE COMPATIBLE 
WITH ABILITY** 


2.8 
1.1 


2.3 
1.1 


2.3 
1.1 


2.3 
0.8 






141 


192 


114 


56 


3. 


FLEXIBLE ENTRANCE 


3.3 


2.4 


2.3 


2.4 




TO NEXT COURSE LEVEL*** 


1.2 


1.1 


1.0 


0.9 






141 


191 


114 


55 




F (3, 505) = 4.24, p = 
1984 and 1985. 


0.01. 


Significant 


difference 


between 




F (3, 502) = 8.43, p = 
1984 and 1985, 1984 and 


<.001. 
1986, 


Significant 
1984 and 1987 


difference 


between 




F (3, 500) = 26.53, p ^ 
1984 and 1985, 1984 and 


<.001. 
1986, 


Significant 
1984 and 1987 


difference 


between 
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PROJECT ABC: PAI^ALLEL CORE PROGRAM MODEL, 
ANALYSIS OF VARIANCE FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1984-1987 
STUDENTS 



VARIABLE 



SOURCE 



SS 



df 



MS F p 



1. STOP MECHANISM 



Between Groups 
Within Groups 
Total 



8.96 
353.62 
362.59 



3 
502 
505 



2.99 

0.70 4.24 0.0^ 



2. LEARNING RATE 
COMPATIBLE 
WITH ABILITY 



Between Groups 
Within Groups 
Total 



28.60 3 
563.96 499 
592.56 502 



FLEXIBLE ENTRANCE 
TO NEXT COURSE 
LEVEL 



Between Groups 
Within Groups 
Total 



93.91 
586.51 
680.42 



3 
497 
500 



9.53 

1.13 8.43 <.001 



31.30 

1 .18 26.53 <.001 
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Stop Mechanism 



in o 



4.5- 



3.5 



2.5 




1984 1985 1986 1987 



Learning Rate Compatible with Ability 




1984 1985 1986 1987 
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Flexible Entrance to Next Course Level 




1984 1985 1986 ■• 1987 
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PROJECT ABC: RALLEL CORE PROGRAM MODEL, 
DESCRIPTIVE fATISTICS FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1984-1987 
TEACHERS 





1984 


1985 


1986 


1987 




Mean 


Mean 


Mean 


Mean 


VARIABLE 


s.d. 


s.d. 


s.d. 


s.d. 




N 


N 


M 


N 


1. STOP MECHANISM 


4.0 


3.9 


4.3 


3.9 




.6 


.9 


1.0 


.9 




8 


10 


8 


11 


2. LEARNING RATE COMPATIBLE 


2.6 


2.5 


3.4 


2.6 


WITH ABILITY 


.5 


1.3 


1.5 


1.5 




8 


10 


8 


11 


3. FLEXIBLE ENTRANCE 


3.6 


2.5 


3.0 


1.8 


TO NEXT COURSE LEVEL 


1.5 


1.6 


1.7 • 


.6 




8 


10 


8 


11 
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PROJECT ABC: PARALLEL CORE PROGRAM MODEL, 
DESCRIPTIVE STATISTICS FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1984-1987 
ADMINISTRATORS 



1984 1985 1986 1987 



Mean Mean Mean Mean 

VARIABLE s.d. s.d. s.d. s.d. 

N N N N 



1. STOP MECHANISM 3.7 3.7 3.7 3.8 

1.4 .9 .9 .4 

6 8 8 6 



2. LEARNING RATE COMPATIBLE 2.0 2.5 2.8 2.4 

WITH ABILITY .g .? 1.0 1.0 

6 8 8 6 



3. FLEXIBLE ENTRANCE 1.7 1.5 1.9 1.5 

TO NEXT COURSE LEVEL ,8 .5 .8 .5 

6 8 8 6 
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PROJECT ABC: PARALLEL CORE PROGRAM MODEL, 
DESCRIPTIVE STATISTICS FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1984-1987 
STUDENTS 





19811 


1985 


1986 


1987 




Mean 


Mean 


Mean 


Mean 


VARIABLE 


s.d. 


s.d. 


s.d. 


s.d. 




N 


N 


N 


N 


1 . TEST USE AT 


4.3 


4.7 


4.5 


4.5 


UNIT LEVEL* 


1.3 


0.6 


0.7 


0.7 




142 


192 


115 


57 


2. DEMONSTRATE COMPETENCY 


2.7 


2.8 


2.6 


2.4 


BEFORE PROCEEDING 


1.2 


1.0 


0.9 


0.9 




136 


192 


115 


56 


3. ADVANCEMENT BASED 


3.3 


2.3 


2.0 


2.3 


ON COMPETENCY** 


1.3 


1.2 


1.2 


1.1 




137 


191 


113 


55 



*F (3, 505) = 5.39, P = <.001. Significant difference between 
1984 and I985. 

** F (3, 495) = 26.71, p = <.001. Significant difference between 
1984 and I985, 1984 and I986, 1984 and 1987. 
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PROJECT ABC: PARALLEL CORE PROGRAM MODEL, 
ANALYSIS OF VARIANCE FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1984-1987 
STUDENTS 



VARIABLE SOURCE SS df MS 



1. TEST USE Between Groups 13.44 3 4.48 

AT UMIT LEVEL Within Groups 417.04 502 0.83 5.39 <.001 

Total 430.48 505 



2. DEMONSTRATE 

COMPETENCY BEFORE 
PROCEEDING 



Between Groups 8.57 3 2.86 
Within Groups 541.52 495 1.09 
Total 550.08 493 



2.61 0.05 



3. ADVANCEMENT BASED 
ON COMPETENCY 



Between Groups 
Within Groups 
Total 



117.90 3 
723.81 492 
841.71 495 



39.30 
1.47 26.71 <.001 
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in o 



(/) o 



-+- Q) 



Test Use at Unit Level 




1984 1985 1986 1987 

Demonstrate Competency before Proceeding 
5 




1984 1985 1986 1987 
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Advancement Based on Competency 




1984 1985 1986 1987 
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PROJECT ABC: PARALLEL CORE PROGRAM MODEL, 
DESCRIPTIVE STATISTICS FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1984-1987 
TEACHERS 







1984 


1985 


1986 


1987 






Mean 


Mean 


Mean 


Mean 




VAKIABLE 


s.d. 


s.d. 


s .d. 


s.d. 






N 


N 


N 


li 


1. 


TEST USE AT 


4.8 


4.9 


5.0 


4.9 




UNIT LEVEL 


.4 


.3 


.0 


.3 






8 


10 


8 


11 


2. 


DEMONSTRATE COMPETENCY 


2.5 


3.2 


3.4 


2.7 




BEFORE PROCEEDING 


1.1 


.8 


1.2 


.7 






8 


10 


8 


11 


3. 


ADVANCEMENT BASED 


3.8 


3.2 


3.9 


2.1 




ON COMPETENCY 


1.5 


1.4 


1.5 


.7 






8 


10 


8 


11 
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PROJECT ABC: PARALLEL CORE PROGRAM MODEL, 
DESCRIPTIVE STATISTICS FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1984-1987 
ADMINISTRATORS 



]m 1985 1986 1987 



Mean Mean Mean Mean 

VARIABLE s.d. s.d. s.d. s.d. 

N N N N 



1. TEST USE AT 4.7 4.6 4.7 4.7 

UNIT LEVEL ,5 ^7 ^5 5 

6 8 8 6 



2. DEMONSTRATE COMPETENCY 3.5 3.2 3.5 3.3 

BEFORE PROCEEDING , q 1.0 8 

6 8 8 6 



3. ADVANCEMENT BASED 1.6 1.5 1.7 2.2 

ON COMPETENCY g q y ,2 

6 8 8 6 
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APPENDIX 3 

Statistical Findings 
School-wide Model 
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Comments 



STUDENT ACHIEVEMENT 

To respond to the question What changes occurred to the achievement 
of progress students during the course of the project, Math 30, Math 33 
and Typing 30 were subjected to univariate analysis of variance 
with year as a factor to determine change over time in students' 
achievement levels within the project school. The program 
employed was the SPSS ONEWAY with post hoc testing. 

Highlights of the statistical analysis indicate that Math 30 
showed sign if ican t change over time • An F ( 1 , 74 ) = 8 • 75 , 
p - <.001 was identified in Scheffe procedure (post hoc ONEWAY 
contrast) yielded a significant difference between the grades in 
1985-1986 and 1986-1987. There was a significant increase in the 
mean from 60.6 to 73 . 3 The mean grades were s ign i f ican tly 
different at the .05 level. 

To respond to the question How did achievement levels of project 
students compare with those of non-project students within the system and 
within the province, eight courses were subjected to univariate 
analysis of variance with student population (school, city and 
province) as a factor to determine significant differences between 
groups throughout Project ABC. The program employed was the 
SPSS-X ONEWAY with post hoc testing. 

Highlights of the statistical analysis indicate that students' 
grades in Math 30 in 1986-1987 were significantly higher than the 
city and the province and their grades in English 30 were signifi- 
cantly lower than the control groups in the final year of Project 
ABC. An F (2, 22467) = 6.01, p = <.001 was identified in the 
analysis of variance for Math 30 in Year 5 and the Scheffe proce- 
dure yielded a significant difference between the achievement 
levels in the school anc* the controls. An F (2, ?o976) = 8.04, 
p = <.001 was identified in the analysis of variani^e for English 
30 in Year 5 and the Scheffe procedure yielded a significant 
difference between the achievement levels in the school and in the 
control groups. Both were significantly different at the .05 
level. 
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TIME REMOVED AS A CREDIT REQUIREMENT 

The variables stop mechanism , learning rate compatiL ? mth ability^ 
and flexible entrance to the next course level extracted from the 
student questionnaire were subjected to univariate analysis of 
variance with year as a factor to determine change over time. The 
program employed was the SPSS ONEWAY with post hoc testing. 

Highlights of the statistical analysis indicate that with a 
project success rate set at a mean score of 3.5, the students 
perceived successful goal attainment in terms of the development 
of a stop mechanism and in providing flexible entrance to the next 
course level in 1986 but their views of variable frequency fell 
back in 1987, and did not achieve success in terms of providing 
compatibility between learning rate and ability. All three items were 
still very volatile by project end. 

Students' perceptions indicated that the provision of a stop 
mechanism while satisfactory in 1984 to 1986, declined in 1987. 
This variable was very significant with an F (3, 3759) = 10.19, 
p = <.001. The Scheffe procedure indicated significant differ- 
ences between 1984 and 1987, 1985 and 1987, and 1986 and 1987. 
The mean for 1987 was significantly lower than the previous three 
years' means. 

Students' perceptions regarding the provision for compatibility 
between learning rate and ability remained at developmental levels 
from 1984 to 1986 (i.e., mean scores between 3.0 and 3.5) but 
declined significantly in 1987. The variable was very significant 
with an F (3, 3753) = 87.83, p = <.001. The Scheffe procedure 
indicated significant differences between 1984 and 1987, 1985 and 
1987, and 1986 and 1987. Thp mean for 1987 was significantly 
lower than the mean in any of the three previous years. 

Students' perceptions regarding the provision of flexible entrance 
to the next course level also declined by project end. The variable 
was very significant with an F (3, 3734) = 27.84, p = <,001. The 
Scheffe procedure indicated significant differences between 1984 
and 1987, 1985 and 1987, 1986 and 1987, and 1984 and 1985. There 
was a significant decrease in the mean from 1984 to 1985 and the 
mean for 1987 was significantly lower than the mean in any of the 
three previous years. 

Descriptive statistics for teacher and administrator perceptions 
of these variables, extracted from their respective question- 
naires, are also included although no analysis of variance was 
conducted due to small sample size. 

Interview data referred to in the main text is reported in the 
five Formative Evaluation Reports. 
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COMPETENCY THE BASIS FOR AWARDING CREDIT 

The variables test use at the unit level, demonstrated competency at the 
unit level before proceeding and advancement based on competency, not 
time on the student questionnaire were also subjected to a univa- 
riate analysis of variance with year as a factor to determine 
change over time. The program employed was the SPSS ONEWAY with 
post hoc testing. 

Highlights of the statistical analysis indicate that with a 
project success rate set at a mean score of 3.5, students 
perceived succe.ssful goal attainment in relation to all three 
criteria for competency becoming the basis for awarding credit. 

Test use at the unit level was perceived by students to be at satis- 
factory levels throughout the project. The variable was very 
significant with an F (3, 3759) = 39. 13, p = <.001. The Scheff§ 
procedure indicated significant differences between 1984 and 1986 
1984 and 1987, 1985 and 1986, 1985 and I987, and 1986 and 1987' 
There was a significant increase in the mean from 1984 and 1985 to 

1986, and from 1984 and 1985 to 1987. There was also a signifi- 
cant increase in the r san from 1986 to 1987. 

Students' perceptions regarding the requirement that students 
demonstrate competency before proceeding to the next unit attained a 
project success level in 1986 and although declining somewhat in 

1987, remained satisfactory. This variable was very significant 
with an F (3, 3753) = 21.40, p = <.001. The Scheffe procedure 
indicated significant differences between 1984 and 1986 1985 and 

1986, 1985 and 1987, and 1986 and 1987. There was a significant 
increase m the mean from 1984 and 1985 to 1986, and I985 to 

1987. There was a significant decrease in the mean from 1986 to 
1987. 

Students' perceptions regarding the criterion of advancement based 
on competency remained at satisfactory levels throughout the 
study. The variable was significant with an F (3, 3751) = 4.50, 
p = <.001. The Scheffe procedure indicated significant differ- 
ences between 1984 and 1985, and 1985 and 1986. There was a 
significant decrease in the mean from 1984 to 1985 and then a 
significant increase from 1985 to 1986." 

Descriptive statistics for teacher and administrator perceptions 
of these variables are also included although no analysis of 
variance was conducted due to small sample size. 

Interview data referred to in the main text is reported in the 
five Formative Evaluation Reports. 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT 
SCHOOL-WIDE MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 



1986-1987 



COURSE 




1986 


1987 


1. MATH 30* 


Mean 


60.6 


73.3 




s.d. 


9.9 


13.0 




N 


10 


65 


2. MATH 33 


Mean 


56.3 


55.^ 




s.d . 


16.5 


15.6 




N 




38 


3- TYPING 30 


Mean 


65.9 


70.7 




s.d. 


20.1 


12.8 




N 


17 


17 


*F (1, m) = 8.75, p 
1986 and 1987. 


= <.001. 


Significant 


difference between 
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ANALYSIS OF VARIANCE FOR STUDENT ACHIEVEMENT 
SCHOOL-WIDE MODEL 

1986-1987 



VARIABLE SOURCE SS df MS 



!• MATH 30 Between Groups 1399.54 1 1399.54 

Within Groups 11674.25 73 159.92 8.75 <.001 
Total 13073.79 74 



MATH 33 Between Groups 14.92 1 14.92 

Within Groups 20595.33 80 257.44 0.06 0.81 
Total 20610.24 81 



3. TYPING 30 Between Groups 192.97 1 192.97 

Within Groups 9068.47 32 283.39 0.68 0.42 

Total 9261.44 33 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, MATH 30, 

SCHOOL-WIDE MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 



1986-1987 





MATH 30 






1986 


1987* 


1 


. School-wide 


Mean 




60.6 


73.3 




Model 


s.d. 




9.9 


13.0 






N 




10 


00 


2 


. Calgary Board 


Mean 




63.6 


67.7 




of Education 


s.d. 




15.5 


15.7 






N 




3788 


3967 


3 


. Province of 


Mean 




65.1 


68.3 




Alberta 


s.d. 




15-5 


15.7 






N 




17470 


18435 


« 


F (2, 221167) .- 6.01, p 


= <.001. 


Signi 


ficant 


difference between 




Mode-l and both control 


groups in 


1987. 
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DESCRIPTIVE STATISTICS FOR STUDENT \CHIEVEMENT, MATH 33, 

SCHOOL-WIDE MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 

1986-1987 



MATH 33 1986 1987 



1. School-wide Mean 56.3 55. l| 

Model s.d. 16.5 15.6 

N 44 38 



2. Calgary Board Mean 56.1 56.7 

of Education s.d. 13.9 13.4 

N 1916 2019 



3. Province of Mean 57.9 58.3 

Alberta s.d. 13.3 13.3 

N 7748 8465 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, TYPING 30, 

SCHOOL-WIDE MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 

1986-1987 

TYPING 30 1986 1987 

1. School-wide Mean 65.9 70.7 
Model s.d. 20.1 12.8 

N 17 17 

2. Calgary Board Mean 66.0 65.7 
of Education s.d. 14.1 13.6 

N 371 363 

3. Province of Mean 67.2 67.9 
Alberta s.d. 13. 8 13.7 

N 3001 2695 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, ENGLISH 30, 

SCHOOL-WIDE MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 

1987 





ENGLISH 30 






1987* 


1 


. School-wide 


Mean 




60.8 




Model 


s.d. 




9.9 






M 




112 


2 


, Calgary Board 


Mean 




64.9 




of Education 


s.d. 




11.1 






N 




4575 


3 


. Province of 


Mean 




65.0 




Alberta 


s.d. 




11.0 






N 




22294 




F (2, 26976) = 8.04, p 


= <.001. 


Significant 


difference between 




Model and both control 


groups in 


1987. 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, 
SOCIAL STUDIES 30, SCHOOL-WIDE MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 

1987 









igoY 


1. 


School -wide 


Mean 


64. 2 




Model 


s.d. 


11.1 






N 


103 


2. 


Calgary Board 


Mean 


65.3 




of Education 


s.d. 


12.4 






a 


3643 


3. 


Province of 


Mean 


64.8 




Alberta 


s.d. 


12.6 






N 


19563 



o 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, BIOLOGY 30, 

SCHOOL-WIDE MODEL, 

CALGARY BOARD OF EDUCATION AND PROVINCE OP ALBERTA 

1987 

BIOLOGY 30 1987 

1. School-wide Mean 64.1 
Model s.d. 13.8 

N 61 

2. Calgary Board Mean 65.6 
of Education s.d. 14.9 

N 3581 

3. Province of Mean 66.0 
Alberta s.d. 14.8 

N 17844 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, CHEMISTRY 30, 

SCHOOL-WIDE MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 

1987 



CHEMISTRY 30 1987 



1. School-wide Mean 71.7 

Model s.d. 13.O 

N 68 



2. Calgary Board Mean 68.4 

of Education s.d. m.9 

N 2955 



3. Province of Mean 68.0 

Albprta s.d. 14.7 

N 15471 



ir 
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DESCRIPTIVE STATISTICS FOR STUDENT ACHIEVEMENT, PHYSICS 30, 

SCHOOL-WIDE MODEL, 
CALGARY BOARD OF EDUCATION AND PROVINCE OF ALBERTA 

1987 

PHYSICS 30 1987 

1. School-wide Mean 64.7 
Model s:d. 12.1 

N 38 

2. Calgary Board Mean 68.2 
of Education s.d. 14.8 

N 1612 

3. Province of Mean 67.8 
Alberta s.d. 14.5 

N 8181 
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PROJECT ABC STUDENT ACHIEVEMENT 
ANALYSIS OF VARIANCE OF SCHOOL-WIDE MODEL, 
SYSTEM AND PROVINCE FINAL GRADES 



1987 





VARIABLE 


SOURCE 


SS 


df 


MS 


F 


P 


1. 


MATH 30 


Between Groups 

U 1 ^ K 1 n Ovarii t r\f 

nlTiiin urOUpS 

Total 


2967,85 
5548701,86 


2 

^^404 
22467 


1483,92 
246,87 


6,01 


<,001 


2. 


MATH 33 


Between Groups 
w 1 Tn 1 n uroups 
Total 


4339,50 
1862139,33 


2 

10521 


2169,75 
1 76,61 


12,29 


<,001* 


3. 


TYPING 30 


Between Groups 
n 1 Tn 1 n uroups 
Total 


1664,89 
0 / jjH / , jy 
575012,48 


2 

3074 


832,45 
1 86,64 


4,46 


0,01* 


4. 


ENGLISH 30 


Between Groups 
n 1 Tn 1 n uroups 
Total 


1954,14 
3278534,93 


2 

2oy74 

26976 


977,07 
121 ,47 


8,04 


<,00l 


5. 


SOCIAL STUDIES 30 


Between Groups 
Within Groups 
Total 


618,85 
3662160,15 
3662779,00 


2 

23306 
23308 


309,42 
157,13 


2,00 


0, 14 


6. 


BIOLOGY 30 


Between Groups 
Within Groups 
Total 


717,94 
4697109,57 
4697827,51 


2 

21483 
21485 


338,97 
218.64 


1,64 


0,19 


7, 


CHEMISTRY 30 


Between Groups 
Within Groups 
Total 


1313,56 
4006038,44 
4007352,01 


2 

18491 
18493 


656,78 
216,65 


3,03 


0,05*» 


8« 


PHYSICS 30 


Between Groups 
Within Groups 
Total 


587,98 
2071128,08 
2071716,06 


2 

9828 
9830 


293,99 
210,74 


1,40 


0,25 



* Significant differences occurred betv/een control groups only. 

* Posthoc tests indicated differences were not significant. 
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PROJECT ABC STUDENT ACHIEVEMENT 
ANALYSIS OF VARIANCE OF SCHOOL-WIDE MODEL, 
SYSTEM AND PROVINCE FINAL GRADES 

1986 



VARIABLE SOURCE SS df MS 



1. MATH 30 Between Groups 6881.00 2 3440.50 

Within Groups 5081729-49 21265 238.97 14.40 <.001* 
Total 5088610.49 21267 



2. MATH 33 Between Groups 4940.17 2 2470.08 

Within Groups 1760462.65 9705 181.40 13.62 <.001« 
Total 1765402.8? 9707 



3. TYPING 30 Between Groups 489.69 2 244.84 

Within Groups 647716.1 1 3386 191 .29 1 .28 0.28 
Total 648205.80 3388 



Significant differences occurred between control groups only. 
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PROJECT ABC: SCHOOL-WIDE MODEL, 
DESCRIPTIVE STATISTICS FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1984-1987 
STUDENTS 







1984 


1985 


1986 


1987 






Mean 


Mean 


Mean 


Mean 




VARIABLE 


s • d • 




o « u « 


o • a • 






N 


N 


N 


N 


K 


STOP MECHANISM^ 


3,7 


3*7 


3,6 


3,5 






1,0 


^0 


1,0 


KO 






413 


783 


999 


1565 


2- 


LEARNING RATE CWATIBLE 


3*4 


3,2 


3,4 


2.7 




WITH ABILITY** 


K2 


K4 


K3 


K2 






410 


783 


997 


1564 




ILEXIQLE ENTRANCE TO 


4,0 


3,6 


3,8 


3*4 




mxr COURSE level >•«* 


K4 


K4 


1,3 


K4 






407 


782 


989 


1557 



*F (3, 3759) = 10.19, P = <.001. Significant difference 

between 1984 and 1987, 1985 and 1987, 1986 and 1987. 

**F (3, 3753) = 87 S3, p = <.001. Significant difference 

between 1981 and 1987, 1985 and 1987, 1986 and 1987. 

F (3, 373*1) = 27.81, p = <.001. Significant difference 

between 1984 and 1987, 1985 and 1987, 1986 and 1987. 
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PROJECT ABC: SCHOOL-WIDE MODEL, 
ANALYSIS OF VARIANCE FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1984-198? 
STUDENTS 



VARIABLE 



SOUFiCE 



SS 



df 



MS 



1 . STOP MEGHAN I SM 



Between Groups 
Within Groups 
Total 



30.17 3 
3706.12 3756 
3736.29 3759 



10.06 
0.99 



10.19 <.001 



2. LEARNING RATE 
COMPATIBLE 
WITH ABILITY 



Between Groups 
Within Groups 
Total 



419.81 3 139.94 
5975.06 3750 1.59 
6394.87 3753 



87.83 <.001 



3. FLEXIBLE ENTRANCE 
TO NEXT COURSE 
LEVEL 



Between Groups 
Within Groups 
Total 



155.32 3 
6938.65 3731 
7093.97 3734 



51.77 
1.86 



27.84 <.001 
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Stop Mechanism 



c 
in O 




1984 1985 1986 1987 



Learning Rate Compatible with Ability 



c 

"(O O 

ll 




1984 1985 1986 1987 

Flexible Entrance to Next Course Level 

5- 



w o 



(D 



CD 




1984 1985 1986 1987 
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PROJECT ABC: SCHOOL-WIDE MODEL, 
DESCRIPTIVE STATISTICS FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1984-1987 
TEACHERS 



1 984 1985 1986 1987 

Mean Mean Mean Mean 

VARIABLE s.d. s.d. s.d. s.d. 

N N N N 



1. STOP MECHANISM 4.4 3.6 3.9 4.0 

.7 .6 .8 .6 

8 12 11 14 



2. LEARNING RATE COMPATIBLE 3.6 3.5 3.4 3.6 

WITH ABILITY .5 7 

8 12 n 14 



3. FLEXIBLE ENTRANCE TO 4.1 3.2 4.5 3.9 

NEXT COURSE LEVEL ^ ,3 g ^ 

8 12 11 14 
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PROJECT ABC: SCH'^OL-WIDE MODEL, 
DESCRIPTIVE STATISTICS FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1984-1987 
ADMINISTRATORS 





1984 


1985 


1986 


1987 




Mean 


Mean 


Mean 


Mean 




o • U • 


S .0 . 


s .ci . 


s.d. 




N 


N 


M 




1. STOP MECHANISM 


5.5 




4.1 


3.5 




.9 


.8 


•8 






4 


12 


11 


12 


2. LEARNING RATE COMPATIBLE 


3.8 


3.7 


3.8 


3.6 


WITH ABILITY 




.9 


1.0 




.4 


1.0 




4 


12 


11 


12 


3. FLEXIBLE ENTRANCE TO 


2.5 


3.3 


3.8 


3.9 


NEXT COURSE LEVEL 


.5 


1.0 


.7 


.9 




4 


12 


11 


12 
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PROJECT ABC: SCHOOL-WIDE MODEL, 
DESCRIPTIVE STATISTICS FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1984-1987 
STUDENTS 









1984 


1985 


1986 


19P7 




VARIABLE 




Mean 
s,d, 
N 


Mean 
s.d. 
N 


Mean 
s.d, 

N 


Mean 
s.d, 
M 


1. 


TEST USE AT 
U'^'IT LEVEL* 




3.8 
1.7 


3.9 
K4 


4,2 
1,2 


4,4 
1,0 








415 


787 


991 


1567 




DEMC.MSTRATE COMPETENCY 
BEFORE PROCEEDING** 




3.3 
1.8 


3.3 


3,8 
1.4 


3.5 
1,5 








414 


788 


990 


1562 


3. 


ADVANCEMENT BASED 
ON COMPETENCY*** 




4J 
1.3 


3.9 
K4 


4,1 
1.2 


4,0 
1.2 








412 


783 


993 


1564 


if 


F (3, 3759) = 39-13, 
between 1984 and 1986, 
1987, 1986 and 1987- 


P = <. 

1984 and 


001 . Significant 
1987, 1985 and 1986 


difference 
, 1985 and 




F (3, 3753) = 21,40, 
between 1984 and 1986, 
1987. 


P = <• 
1985 and 


001, Signific.^nt 
1986, 1985 and 1987 


difference 
, 1986 and 



F (3, 3751) = 4.50, p = <.001. Significant difference between 
1984 and 1985, 1985 and 1986. 
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PROJECT ABC: SCHOOL-WIDE MODEL, 
ANALYSIS OF VARIANCE FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1984-1987 
STUDENTS 

VARIABLE SOURCE SS df MS F 



1 . TEST USE AT 
UNIT LEVEL 



?. DEMONSTRATE 

COMPETENCY BEFORE 
PROCEEDING 



Betweet; Groups 
Within Groups 
Tot al- 



ly?. 03 3 
5663.94 3756 
5840.98 3759 



59.01 

1 .51 39.13 <.001 



50.49 

2.36 21.40 <.001 



6.85 

1.52 4.50 <.001 



Between Groups 151.48 3 
Within Groups 8846.92 3750 
Total 8998.40 3753 



ADVANCEMENT BASED Between Groups 20.55 3 
ON COMPETENCY Within Groups 5701.35 3748 

Total 5721.89 3751 
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CO O 



Test Use at Unit Level 




1984 1985 1986 1987 

Demonstrate Competency before Proceeding 
5 




1984 1985 1986 1987 



Advancement Based on Connpetency 

5 




1984 1985 1986 1987 
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PROJECT ABC: SCHOOL-WIDE MODEL, 
DESCRIPTIVE STATISTICS FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1984-1987 
TEACHERS 



1284 j985 198S 1987 



Mean Mean Mean Mean 

VARIABLE s.d. s.d. s.d. s.d. 

N N N N 



1 , TEST USE AT 4.8 4.8 4.8 4.9 

UNIT LEVEL „ 3 

8 12 11 <4 



2. OEMCNSTRArE COMPETENCY 4.4 3.5 4.3 4.3 

BEFORE PROCEEDING g ,5 g g 

8 12 11 14 



3. ADVANCEMENT BASED 4.1 3.8 4.9 4.9 

OM COMPETENCY a 10 -z 

.0 1.^ .J .J 

8 12 M 14 
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PROJECT ABC: SCHOOL-WIDE MODEL, 
DESCRIPTIVE STATISTICS FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1984-1987 
ADMINISTRATORS 







iqsu 




1986 


1987 






Mean 


Mean 


Mean 


Mean 




VARIABLE 


s.d. 


s.d. 


s.d. 


s.d. 






N 


M 


M 


N 




TEST USE AT 


4.0 


4.5 


4.7 


4.8 




UNIT LEVEL 


.0 








.7 


.5 


.6 






4 


12 


11 


12 


2. 


DEMONSTRATE COMPETENCY 


3.7 


4.3 


4.5 


4.4 




BEFORE PROCEEDING 


.5 


.8 




• 7 


.6 






4 


12 • 


11 


12 


3. 


ADVANCEMENT BASED 


4.3 


4.3 


4.9 


4.8 




ON COMPETENCY 


.4 


.6 






.3 


.4 






4 


12 


11 


12 
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APPENDIX 4 

Statistical Findings 
Overall Comparisons 



ERIC 



256 



Comments 



STUDENT ACHIEVEMENT 

There was no statistical analysis carried out to compare achieve- 
ment levels of students ajnong the three Project schools. 
Comparisons within each school over time and between each school 
and the Calgary Board of Education student population and the 
Province of Alberta student population were conducted. 



TIME REMOVED AS A CREDIT REQUIREMENT 

The variables stop mechanism, learning rate compatible mth ability, 
and flexible entrance to the next course level extracted from the 1987 
student questionnaire for each of the three models were subjected 
to univariate analysis of variance comparing responses among the 
three models. The program employed was the SPSS ONEWAY with post 
hoc testing. 

Generally, statistical findings indicated that no model achieved 
the project success level of 3.5 according to students* percep- 
tions for all three variables related to the removal of time as a 
credit requirement. 

The variable of a stop mechanism was significant in 1987 with an F 
(2, 1644) = 6.74, p = <,001. The Scheffe procedure indicated 
significant differences between the Parallel Core Program Model 
and the School-wide Model. The mean response for the Parallel 
Core Program Model wab significantly higher than the mean response 
for the School-wide Model in the final year of the project. 

The variable learning rate compatible with ability was not achieved by 
any of the three models to a successful degree according to 
students' perceptions. No significant differences among the three 
models were recorded in 1987. 

The variable flexible entrance to the next course level was very signi- 
ficant in 1987 with an F (2, 1634) = 16.67, p = <.001. The 
Scheffe procedure indicated significant differences between the 
Department^based Model and the Parallel Core Program Model and 
between the School-wide Model and the Parallel Core Program 
Model. The mean responses of students for both the Department- 
based Model and the School-wide Model were significantly higher 
than the mean response for the Parallel Core Program Model. 

Descriptive statistics for teacher and administrator perceptions 
of these variables for 1987 across models were extr'^-^t'ed from 
their respective questionnaires and are also included, aiunough no 
analysis of variance was conducted due to small sample size. 
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Interview data referred to in the main text is reported in the 
five Formative Evaluation Reports. 



COMPETENCY THE BASIS FOR AWARDING CREDIT 

The variable test use at the unit level, demonstrated competency at the 
unit level before proceeding and advancement based on competency, not 
time on the 198? student questionnaire was also subjected to a 
univariate analysis of variance comparing responses among the 
three models. The program employed was the SPSS ONEWAY with post 
hoc testing. 

Generally, statistical findings indicated that according to 
student perceptions, the School-wide Model achieved the project 
success level of 3-5 for all three variables related to competency 
becoming the basis for awarding credit. 

The variable test use at the unit level, was not significant in 1987 
as all three models achieved high levels of success for this 
project criterion. 

The variable demonstrated competence before proceeding was very 
significant in I987 with an F (2, 1640) = 15.41, p = <.001. The 
Scheffe procedure indicated significant differences between the 
School-wide Model and the Parallel Core Program Model in I987. 
The mean response for the School-wide Model was significantly 
higher than the mean response for the Parallel Core Program Model 
for this variable in the final year of the project. 

The variable advancement based on competency^ not time was very 
significant in I987 with an F (2, 1641) = 56.74, p = <.001. The 
Scheffe procedure indicated significant differences between the 
School-wide Model and the Parallel Core Program Model and between 
the Department-based Model and the Parallel Core Program Model. 
The mean responses for the School-wide Model and the Department- 
based Model were both significantly higher than the mean response 
for the Parallel Core Program Model in the final year of the 
project. 

Descriptive statistics for teacher and administrator perceptions 
of these variables are also incJ ided although no analysis of 
variance was conducted due to small sample size. 

Interview data referred to in the main text is reported in the 
five Formative Evaluation Reports. 



ERLC 



25S 



- 235 - 



PROJECT ABC: COMPARISON OF THREE MODELS, 
DESCRIPTIVE STATISTICS FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1987 
STUDENTS 



DEPARTMENT- PARALLEL CORE SCHOOL-WIDE 
BASED MODEL PROGRAM MODEL MODEL 



1. STOP MECHANISM* Mean 4.0 3*9 5.5 

s.d. 1.0 0,6 1 .0 

N 23 57 1565 



2. LEARNING RATE Mean 2.9 2.3 2.7 



COMPATIBLE 
WITH ABILITY 



S.d. 1.1 0.8 1.2 

N 23 56 1564 



3. FLEXIBLE ENTRANCE Mean 4.0 2.4 3.4 



TO NEXT COURSE 
LEVEL»» 



S.d. l.O 0.9 1.4 

N 23 55 1557 



* F (2, 16HH) = 6.7^1, p = <.001. 
Parallel Core Program Model and 

F (2, 163^) = 16.67, p = <.001. 
Department-based Model and the 
between the School-wide Model 
Model- 



Significant difference between 
the School-wide Model. 

Significant difference between 
Parallel Core Program Model and 
and the Parallel Core Program 
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PROJECT ABC: COMPARISON OF THREE MODELS 
ANALYSIS OF VARIANCE FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1987 
STUDENTS 



VARIABLE SOURCE SS df MS F 



1. STOP MECHANISM Between Gr-)ups 12. 6i 2 6.31 

Within Groups 1536.30 1642 0.94 6.74 <.001 
Total 1548.91 1644 



2. LEARNING RATE Between Groups 9.21 2 4.61 

COMPATIBLE WITH Within Groups 2319.65 1640 :.41 3.26 0.04 

ABILITY Total 2328.86 1642 



3. FLEXIBLE ENTRANCE Be. weeii Groups 61.50 2 30.75 

TO NEXT COURSE Within Groups 3011.33 1632 1.85 16.67 <.001 

LEVEL Total 3072.83 1634 
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Stop Mechanism 



c 
a 

CL 



c 

0) 

3 
(?) 




1984 



1985 1986 
Year 



Legend 



• Aberhart 



O Die f en bak er 
• Manning^ 



1987 



Learning Rate Compatible with Ability 




Legend 

■ Aberhart 
□ Diefenbak er 
• Manning__ 



1984 



1985 1986 
Year 



1987 



Flexible Entrance to Next Course Level 

5-.— 




1984 



196" 1986 
Year 



Legend 

J ■ Aberhart 

— O Diefenbak er 

i • Manninq 
— i ^ 

1987 
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PROJECT ABC: COMPARISON OF THREE MODELS, 
DESCRIPTIVE STATISTICS FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1987 
TEACHERS 



DEPARTMENT- PARALLEL CORE SCHOOL-WIDE 

B/iSFC MODEL PROGRAM MODEL MODEL 



K STOP MECHANISM Mean 4,4 3.9 4.0 

s.d. 4.9 .9 .6 

N 5 II 14 



2. LEARNING RATE Mean 4.6 2.6 3.6 

COMPATIBLE 
WITH ABILITY 



COMPATIBLE 3^^^ ^5 ^7 



N 5 11 14 



3. FLEXIBLE ENTRANCE Mean 4.2 1.8 3.9 

TO NEXT COURSE 3^^^ ^4 
LEVEL 

N 5 II 14 
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PROJECT ABC: COMPARISON OF THREE MODELS, 
DESCRIPTIVE STATISTICS FOR THE REMOVAL 
OF TIME AS A CREDIT REQUIREMENT 

1987 
ADMINISTRATORS 



DEPARTMENT- 
BASED MODEL 



PARALLEL CORE 
PROGRAM MODEL 



SCHOOL -WIDE 
MODEL 



K STOP MECHANISM 



2. LEARNING RATE 
COMPATIBLE 
WITH ABILITY 



Mean 
s.d. 
N 



Mean 
s.d. 
N 



3. FLEXIBLE ENTRANCE Mean 
TO NEXT COURSE g 
LEVEL 

N 



3.8 
.4 
4 



3.8 
.4 
4 



4.0 
.0 

4 



3.8 
.4 
6 



2.4 
1.0 

6 



1.5 
.5 
6 



3.5 
.7 
12 



3.6 
1.0 
12 



3.9 
.9 
12 
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PROJECT ABC: COMPARISON OF THREE MODELS, 
DESCRIPTIVE STATISTICS FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1987 
STUDENTS 







DEPARTMENT- 


PARALLEL CORE 








BASED MODEL 


PROGRAM MODEL 


MODEL 


1 . TEST USE AT THE 


Mean 


4.5 


4.5 


4.4 


UNIT LEVEL 


s.d. 


1.0 


0.7 


1.0 




N 


23 


57 


l'^67 


2. DEMONSTRATE 


Mean 


3.2 


2.4 


3.5 


COMPETENCY 

BEFORE 

PROCEEDING* 


s.d. 
N 


1.6 

23 


0.9 
56 


1.5 

1562 


3. ADVANCEMENT 


Mean 


4.5 


2.3 


4.0 


BASED ON 
COMPETENCY** 


s.d. 
N 


0.8 

23 


55 


1.2 
1564 



* F (2, 1640) = 15.41, p = <.001. Significant difference between 
School-wide '■'odel and the Parallel Core Program Model. 

* F (2, 1641) = 56.74, p = <.001. Significant difference between 
the School-wide Model and the Parallel Core Program Model and 
between the Department-based Model and the Parallel Core 
Program Model. 
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PROJECT ABC: COMPARISON OF THREE MODELS, 
ANALYSIS OF VARIANCE FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1987 
STUDENTS 



VARIABLE SOURCE SS df MS 



1. TEST USE AT Between Groups 1.06 2 .53 

UNIT LEVEL Within Groups 1625.54 1644 .99 o.54 0.58 

Total 1626.60 1646 



2. DEMONSTRATE Between Groups 70.45 2 35.22 

COMPETENCY BEFORE Within Groups 3743.50 1638 2.29 15.41 <.001 
PROCEEDING Total 3813.95 1640 



3. ADVANCEMENT BASED Between Groups 156.55 2 78.27 

ON COf-tPETENCY Within Groups 2260.84 1639 1.38 56.74 <.001 

Total 2417.39 1641 
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Test Use at Unit Level 




1984 



1985 



1986 



Year 



Legend 

a Aberhort 
O Diefcnbok er 
• MonnIng_ 



1987 



Demonstrate Competency before Proceeding 




Legend 

■ Aberhort 
O Diefenbok er 
• Manning^ 



1984 



1985 



1986 



1987 



Year 
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Advancement Based on Competency 
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PROJECT ABC: COMPARISON OF THREE MODELS, 
DESCRIPTIVE STATISTICS FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1987 
TEACHERS 



DEPARTMENT- 
BASED f^EL 



PARALLEL CORE 
PROGRAM MODEL 



SCHOOL-WIDE 
MODEL 



1 . TEST USa AT THE 
UNIT LEVEL 



Mean 
s.d. 
N 



4.4 

.5 
5 



4.9 
• 3 
11 



4.9 
.3 
14 



2 . DEMONSTRATE 
COMPETENCY 
BEFORE 
PROCEEDING 



Mean 
s.d. 
N 



4.0 
.0 
5 



2.7 
.7 
11 



4.3 
.9 
14 



3. ADVANCEMENT Mean 4.8 2.1 4.9 

BASED ON 3,^^ 7 3 
COMPETENCY 

N 5 11 14 
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PROJECT ABC: COMPARISON OF THREE MODELS, 
DESCRIPTIVE STATISTICS FOR COMPETENCY 
BECOMING THE BASIS FOR AWARDING CREDIT 

1987 



ADMINISTRATORS 



DEPARTMENT- PARALLEL CORE SCHOOL-WIDE 

BASED MODEL PROGRAM MODEL MODEL 



1. TEST USE AT Tnc Mean 4.8 4.7 4.8 

UNIT LEVEL 3.^^ ,4 5 

N 4 6 12 



2. DEMONSTRATE Mean 4.0 3.3 4.4 

COMPETENCY 3.,, ^ .8 '5 
BEFORE 

PROCEEDING ^ ^ '2 



3. ADVANCEMENT Mean 4.8 2.2 4.8 

BASEDOW 3,^_ ^ ,^3 • 
COMPETENCY 

N 4 4 12 
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STUDENT QUESTIONNAIRE 
PROJECT ABC 
(ABERHART VERSION) 



INSTRUCTIONS: 

1 . Use a "bubble sheet" and an HB pencil to answer these 
questions - do not mark the c. jestionnaire . 

2. Do not write your name on the answer sheet. 

3. If you cannot answer a question, or it is inappropriate for 
you, leave it out . 



Thanks for your help! 
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FOR OFFICE 
USE ONLY 

SO. 10 



STUDENT QUESTIONNAIRE 
PROJECT ABC 



SO. 20 



SO. 30 



ANSWER QUESTIONS 1-3. 



1. 


What school do you go to? 


[ ] William Aberhart 


(01) 






[ ] John Diefenbaker 


(02) 






[ ] Ernest Manning 


(03) 






[ ] Sir Winston Churchill 


(OU) 


2. 


What grade are you in? 


[ ] Grade 10 


(01) 






[ ] Grade 11 


(02) 






[ ] Grade 12 


(03) 


3. 


In what semester are you 


[ ] Semester 1 


(01) 




answering this questionnaire? 


[ ] Semester 2 


(02) 



The rest of the questionnaire asks you about how often you 
can do certain activities in this course and how you feel 
about this course generally. 

You will answer questions on a scale of 1 to 5 where: 



1 = 

2 = 

3 = 
H = 
5 = 



Never 

Seldom 

Sometimes 

Usually 

Always 



So that if the question said; 



I like weekends because I can sleep in. 



and you felt that this was "Always" the case, you would 
colour in the 5 bubble on your answer sheet. 



GO ON TO PAGE 2 
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SI .10 

Sil.10 
S4.20 

n.30 

sil.m 

S4.42 

S4.50 

S5.10 

S5.21 

S5.22 

S5.30 

S6.ll 
S6.12 

S6.13 
S6.41 



ANSWER ALL QUESTIONS FROM 4-22. 

(Unless it is not appropriate - then leave it out!) 



4. I am satisfied with my achievement level 
in this course. 

5. I think this is the right course for me. 

6. I can choose where I will learn in this 
course (in the library, in a classroom, 
at home, etc. ) . 

7. I can concentrate on a particular problem 
I dm having until it is solved. 

8. I write a test or do a special assignment 
at the end of each unit in this course. 

9. I must earn a certain mark in this unit 
test or special assignment before 
proceeding to the next unit. 

10. I can use additional materials to go 
beyond course requirements if I want to. 

11. I can spend as long as I need to 
complete course requirements. 

12. I can begin the next course in this 
subject whenever I am ready to do so. 

13. I may timetable my course at any time 
during the school day. 

14. I can exit from this course whenever 
I have completed the requirements. 

15. I like the way this course is organized. 

16. I am satisfied with the amount of 
challenge I am experiencing in this 
course. 

17. I am satisfied with the number of 
students I know in this course. 

18. I am able to communicate with my 
teacher. 



J' 



2 

2 
2 



2 
2 



3 

3 
3 

3 
3 
3 

3 

3 

3 

3 

3 

3 
3 



4 
4 

4 
4 
4 

4 

4 

4 

4 

4 

4 
4 



2 3 4 
GO ON TO PAGE 3 



5 
5 

5 
5 
5 

5 

5 

5 

5 

5 

5 
5 

5 
5 
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S6.il6 
S6.42 
S7.11 

S7.12 



19. I am able to communicate with the 
students in this class. 

20. My teacher takes an interest in my 
success in this course. 

21. I am satisfied with the classroom 
learning materials I use in my 
course. 

22. I am satisfied with school library 
resources that I can use for my 
course. 



12345 



THANK YOU! 
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TEACHER QUESTIONNAIRE 
PROJECT ABC 



INSTRUCTIONS: 

1. Please answer right on this questionnaire. 

2. Put a tick in the box [/] besxde the appropriate answer in the 
first part of the questionnaire. 

3. Circle the appropriate number in the second part of the 
questionnaire depending on your response: 

1 I never. . . 

2 I seldom. . . 

3 I sometimes. . . 

4 I usually . . . 

5 I always. . . 

4. If you cannot answer a question, or it is not applicable, 
leave it out . 

This is the last year of the study - let's make it a good one. 
Thanks for your help! 



Gail V. Barrington, Ph.D. 
Project ABC Evaluator 
(270-7571) 
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TEACH h:r quest lonnairk 

PROJECT ABC 



1# What school do you work in? 



5. 



6. 



How many years of teaching experience 
do you have? 



Are you involved in Project ABC 
(PEP, PACE)? 

How many hours of preparation time 
par week do you have for preparing 
instruction and marking students* 
work? 

How many additional hours of your 
own time per week do you use for 
preparation activities? 



How much release time (including 
professional development days) have 
you been provided with this tenn 
for program development and revision? 



William Aberhart (01) 
John niefenbaker (02) 
Ernest Manning (03) 
Sir Winston Church il 1(04) 



This is my 


first 


year(Ol) 


1-2 years 




(02) 


3-5 years 




(03) 


6-10 years 




(04) 


More than 10 years (05) 


Yes 




(01) 


No 




(02) 


2 hours or 


fewer 


(01) 


3-5 hours 




(02) 


6-9 hours 




(03) 


10 hours or 


more 


(04) 


2 hours or 


fewer 


(01) 


3-5 hours 




(02) 


6-9 hours 




(03) 


10 houi • or 


more 


(04) 


less than 1 


day 


(01) 


1-2 days 




(02) 


3-5 days 




(03) 


movii than 5 


days 


(04) 



7. I feel satisfied with the level of 
student achievement in my courses 
this year. 

0* I feel satisfied with the coverage 
of the Alberta curriculum in my 
courses. 



/ / / / <f 



I 2 } 4 5 



12 3 4 5 



9. I believe that students have been 

selected appropriately for my courses. 



12 3 4 5 
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10. Students choose where they will 
learn (e.g., in the library, in 
a classroom, at home). 



1 2 3 4 5 



11. Students can interrupt their pr-^gress 
to concentrate on a particular problem 
they are encountering until it is solved, 

12. Students are tested for achievement by 
unit tests or special assignments at 

^ 'e end of each unit of my courses. 

13. Students must demonstrate a specific 
level of competence for each unit of 
a course before proceeding to the 
next unit. 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



14. Students have access to enrichment 
material to j|o beyond the content of 
a course if they wish to do so. 

15. Students can take as much time as they 
need to complete course requirements 
based on their learning ne*2ds. 

16. Students may eater the next course Ln 
this subject whenever they are ready 
to do so. 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



17. Students may timetable their courses at 
any time during the school day. 

18. Students ma' ^xic from courses whenever 
they have completed Its requirements. 

19. Students like the way I organize my 
courses. 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



20. Students are receiving sufficient 
challenge in their courses. 

21. I am experiencing a sense of achieve- 
ment as a teacher in my courses. 

22. My work in my courses Is recognized 
by staff members. 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 
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23* I ara satisfied with ray coramunlcat loa 
with ray students* 

24* I ara satisfied that I deraonstrate an 
interest In students' success in my 
courses. 

25 • I am satisfied witli ray corajpunicat JLon 
with other staff raerabers about ray 
courses* 



26* I am satisfied generally with 
coramunication in this school* 

27. I ara satisfied with the classroora 
learning materials available to 
students in my courses* 

28* I ara satisflea with the school 
library resources available to 
students In my courses. 

29. I ara satisfied with the adequacy 

of support provided by teacher aides, 
clerical aides, and/or student pages. 

30. I am satisfied with the adequacy 
of equipraant available for use Ln 
my courses. 

31. I am satisfied with th-^ amount of 
preparation tirae I have per weok 
for preparing instruction and 
marking students' work. 

32. T. ara satisfied with the araount of 
release tirae per terra which I 
receive for prograra development 
rnd revision. 
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ADMINISTRATOR QUESTIONNAIRE 
PROJECT ABC 



INSTRUCTIONS: 

1. Please answer right on this questionnaire. 

2. Put a tick in the box [/] beside the appropriate answer in the 
first part of the questionnaire. 

3. Circle the appropriate number in the second part of the 
questionnaire depending on your response: 

1 I never. . . 

2 I seldom. . . 

3 I sometimes. . . 
U I usually . . . 

5 I always. . . 

4. If you cannot answer a question, or it is not applicable, 
leave it out 



This is the last year of the study - let's make it a good one. 



Thanks for your help! 



Gail V. Harrington, Ph.D. 
Project ABC Evaluator 
(270-7571: 
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AO. 10 



AO. 50 



AKIO 



A2.10 



A4.10 



A4.20 



A4.30 



A4.41 



A4.42 



A4.50 



ADMINISTRATION QUESTLONNAIRE 
PROJECT ABC 



1. What school do you work in? 



2, What is your position? 



( ) WiLliam AberharL 
( J John Diefenbaker 
( I Ernest Manning 



(01) 
(02) 
(03) 



[ J Principal or Assistant Principal (01) 
[ ] Department Head oi Curriculum 

Coordinator (02) 

[ J Counijellor (U3) 



3. I feel satisfied with the level of 
>tudent achievement in Project ABC 
this year. 

4. I feel satisfied with the coverage 
of the Alberta curriculum ifi Project 
ABC courses. 

5. I believe that students have been 
selected appropriately ..or Project ABC 
courses . 

6. Project ABC students choose where they 
will learn (e.g., in the library, in 

a classroom, at home). 

7. Project i\BC students can interrupt their 
progress to concentrate on a particular 
problem they are encountering until it 
is solved. 

8. Project ABC students are tested for 
achievement at the end of each unit. 

9. Project ABC students must demonstrate 

a specific level of competence for each 
unit of a course before proceeding to 
the next unit. 

10. Project ABC students have access to 

enrichment material to go beyond the 

content of a course if they wish to 
do so* 



/ / ^ ^ 

^ ci> ^ 

1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



12 3 4 5 
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A5.10 



A5.21 



A5.22 



A5.30 



A6.ll 



A6. 12 



A6.21 



A6.^2 



A6.23 



AO. 30 



A6.42 



A6.44 



A7.11 



11. 



12, 



14- 



15. 



16, 



17. 



18, 



19. 



20, 



21, 



22, 



23. 



Project ABC students can take as much 
time as they need to complete course 
requirements based on their learning 
needs . 

Project ABC students may enter the next 
course in a subject whjinever they are 
ready to do so. 



13. Project ABC students may timetable their 
courses at any time during the school 
day. 



Project ABC students may exit from 
courses whenever they have completed 
course requirements. 

Project ABC studer.ts like the way 
their courses are organized. 

Project ABC students are receiving 
sufficient challenge In their courses. 

Project ABC teachers are experiencing 
a sense of achievement. 

Project ABC teachers' work is being 
recognized by other staff members. 

I am satisfied with staff morale 
relative to Project ABC. 

I am satisfied with the development 
of Project ABC in my school. 

I am satisfied that Project ABC teachers 
demonstrate ^in interest Ln their 
students* success. 

1 am satisfied with comnunieat ion in 
this school about Project ABC 
(PKP, PACK) 

I am satisfied with the classroom 
learning materials available to 
Project ABC students. 



1 2 



/ 



3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



3 4 5 



1 2 3 4 5 



1 2 3 4 5 



'2 3 4 5 



2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



12 3 4 5 
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A7«12 24. I am satisfied with the school 

library resources available to 
Project aBC students. 

A7.13 25. I an satisfied with the adequacy of 

support provided by teacher aides 
and/or clerical aides through 
Project ABC. 

A7.14 26. I am satisfied with the adequacy of 

equipment available- for use in 
Project ABC. 

A7.21 27. Project ABC teachers have adequate 

preparation time per week for 
preparing instruction and marking 
students* work. 

A7.22 28. Project ABC teachers have adequate 

release time per term for program 
development and revision. 



cf ^ 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 



1 2 3 4 5 
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